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(54) Colour Image pickup apparatus 

(57) To provide an image pickup apparatus that 
generates an image signal having a high resolution both 
horizontally and vertically, the filter arrangement for a 
color filter array used in the apparatus is so designed 
that the colors of the filters in a cyclic patterned unit of N 
rows X N columns (4 lines x 4 columns) differ from each 
other not only on the same line but also in the same col- 
umn. Thus, from all the pixel blocks, pixel signals for 
each predetermined pixel block unit can be obtained 
that are required for the generation of a luminance sig- 
nal and of color signals. 
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Description 

BACKGROUND OF THE INVENTION 
5 Field of the Invention 

[0001 1 The present invention relates to an image pickup apparatus that can obtain an image having a high resolution. 
Related Background Art 

[0002] In a conventional image pickup apparatus for generating an image signal, object light enters via a color filter 
(a filter array) and impinges on a light-receiving face composed of a plurality of photodiodes (hereinafter referred to as 
"pixels" or light detectors"). . a • ^ 

[0003] The color filter types available comprise a primary color filter and a complementary color filter, A primary color 

15 filter is an array in which filters for the three primary colors, red (R) and green (G) and blue (B). are positioned at indi- 
vidual pixels in a predetermined order on the light receiving face. Similarly, a complementary color filter is an array in 
which color filers for four complementary colors, cyan (Cy). yellow (Ye), magenta (Mg) and green (G) are arranged in a 
predetermined order. . .. 

[0004] The processing performed in accordance with a signal obtained by the image pickup apparatus will now be 

20 desaibed while the color filer used for the apparatus is. for example, the above described complementary color filter. 
[0005] First a cyan filter absoifes red light within a visible radiation range, and a yellow filter absorbs blue light within 
a visible radiation range. Whereas while a magenta filter absoibs green light within a visible radiation range a green filter 
transmits only green light. 

[0006] The arrangements used for these color filters will be described later. 

[0007] The image pickup apparatus, wherein object light enters through the complementary color filter array, obtains 
a pixel signal Cy that corresponds to the volume of the light that strikes a pixel after passing through the cyan filter, a 
pixel signal Ye that corresponds to the volume of the light that strikes a pixel after passing through the yellow filter, a 
pixel signal Mg that corresponds to the volume of the light that strikes a pixel after passing through the magenta filter, 
and a pixel signal G that corresponds to the volume of the light that passes through the green filter. 
[0008] The thus obtained pixel signals Cy. Ye. Mg and G are used, as luminance signal Y and color difference signals 
CB and CR. for adjusting the iris or the white balance for a digital still camera or for a detection process performed dur- 
ing auto focusing, or for an image pickup apparatus that performs compression or decompression processing. 
[0009] The luminance signal Y and the color difference signals CB and CR are represented by the following equatons 
(1) to (3). in which the pixel signals Cy. Ye. Mg and G are used. 

Y = Ye+G + Cy + Mg 0) 
CB = (G + Ye)-(Mg + Cy) (2) 
CR = (Cy + G) - (Ye + Mg) (3) 

[001 0] In Figs. 1 and 2 are shown example arrangement patterns for color filters in a complementary filter used for an 

image pickup apparatuses. ^ u * *u u 

[001 1 J In the pattern shown in Fig, 1 for the conrplementary color filter, color filters are so arranged that they have a 

45 cyclic pattern of two pixels horizontally (the direction corresponding to that of C1 . C2. C3. . . . ) and four pixels vertically 
(the direction corresponding to that of LI . L2. L3. . . . )- In the pattern shown in Fig. 2 for the complementary color filter, 
color filters are so arranged that they have a cyclic pattern of two pixels horizontally and eight pixels vertically. 
[0012] With either complementary color filter, the luminance signal Y is obtained by performing the calculations for 
equation (1). for which are used the pixel signals Cy. Ye. Mg and G (shaded portions in Figs. 23 and 24) for pixels in a 

50 four-pixel (2 x 2) block including two pixels horizontally and two pixels vertically Similarly, the color difference signate 
CB and CR can be obtained by performing the calculations for-equations (2).and.(3) that employ the pixel signals Cy. Y, 
Mg and G for pixels in a 2 x 2 pixel block. , . u . 

[0013] However, when a conventional image pickup apparatus, for which object light enters through the color filter 
shown in Fig. 1 or 2. is employed for a digital still camera, for example, the following problems have arisen. 

(1) Before the shutter release is pressed, at the cost of resolution, a digital still camera reads pixel signals (in this 
case the above described image signals Cy. Ye. Mg and G) that are obtained by the image pickup apparatus (fast 
read mode), and based on these signals, displays images on the screen of a liquid crystal viewfinder or adjusts the 
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iris or the white balance. 

When the color filter shown in Fig. 2 is employed for an image pickup apparatus, image pixels obtained by the 
image pickup apparatus can be read In the fast read mode, and the white balance can be adjusted based on the 
signals. However, when the color filter shown in Fig. 1 is employed for an image pickup apparatus, and when for 
5 fast reading, at the cost of resolution, pixel signals for individual pixels are intermittently read vertically, only pixel 

signals Cy and Ye, i.e., pixel signals for only the two colors cyan and yellow, can be obtained, and the processing 
for white balance can not be employed. 

(2) Recently, an image pickup apparatus, such as a CCD. has been provided wherein, by employing an elaborate 
signal reading method, object light is received at the light receiving face and pixel signals for two pixels that are per- 
10 pendicularly adjacent to the light receiving face are added together, the resultant signal being transmitted to the 
transmission unit of the apparatus. As a result, the image pickup apparatus outputs paired pixel signals. 

[0014] Specifically, when the color filter in Fig. 1 is employed for an image pickup apparatus, for lines LI and L2 paired 
pixel signals Cy. for a pixel that Is positioned at (C1, LI), and Mg, for a pixel that Is positioned at (Cl, L2). are output 

15 first, and then paired pixel signals Ye. for a pixel that is positioned at (C2. LI ). and G. for a pixel that is positioned at (C2. 
L2), are output, the pixel signal pairs being sequentially output in the same way. And when the output of signals for lines 
LI and L2 has been completed, for the succeeding lines L3 and L4 paired pixel signals Cy, for a pixel that Is positioned 
at (CI. L3). and G, for a pixel that Is positioned at (C1. L4}. are output first, and then paired pixel signals Ye. for a pixel 
that Is positioned at (C2, L3). and Mg, for a pixel that Is positioned at (C2. L4), are output, the pixel signal pairs again 

20 being sequentially output in the same way, and the output of signals for the lines L3 and L4 is completed. 

[0015] That is, the pixel signals output for lines LI and L2 are (Cy + f^g). (Ye + G), . . .. and the pixel signals output 
for lines L3 and L4 are (Cy -i- G), (Ye + Mg) 

[001 6] However, since luminance signal Y and color difference signals CB and CR are acquired from the above output 
signals, there are signals that can not be used for the calculations performed using equations (2) and (3) to obtain color 

25 difference signals CB and CR. 

[0017] That is. while equation (2) is set up using (G + Ye) and (Mg + Cy). the output signals for lines L3 and L4 are 
(Cy + G), (Ye + Mg). .... and as a result, the calculations for which equation (2) is used can not be performed for lines 
L3 and L4. Similarly, while equation (3) is set up using (Cy + G) and (Ye + Mg), the output signals for lines LI and L2 
are (Cy + Mg), (Ye + G), . . . . and as a result, the calculations for which equation (3) Is used can not be performed for 

30 lines LI and L2. 

[0018] As is described above, a solution for equation (2) can be obtained for the outputs for lines LI and L2. but no 
solution can be obtained for the outputs for lines L3 and L4. Likewise, a solution for equation (3) can be obtained for the 
outputs for lines L3 and L4, but no solution can be obtained for the outputs for lines L1 and L2, 
[0019] Therefore, color signals CB and CR for the individual colors can be obtained only for the pixel signals for one 
35 line, although pixel signals are output for four lines by the Image pickup apparatus. That is, since luminance signal Y 
and color signals CB and CR can not be obtained unless pixel signals for four lines are employed, accordingly, vertical 
resolution is reduced. 

[0020] When the color filter shown in Fig. 2 is employed for the image pickup apparatus, pixel signal pairs are output 
In the same manner: pixel signal pairs of (Cy + Mg). (Ye + G). . . . for lines L1 and L2: pixel signal pairs of (Cy + Mg). 

40 (Ye + G) for lines L3 and L4; pixel signal pairs of (Cy + G). (Ye + Mg). ... for lines L5 and L6; and pixel signal pairs 

of (Cy + G), (Ye + Mg). ... for lines L7 and L8. 

[0021] However, since luminance signal Y and color signals CB and CR are acquired from the above output signals, 

there are signals for which equations (2) and (3). used to obtain color signals CB and CR, can not be solved. 

[0022] That is. while equation (2) is set up using (G + Ye) and (Mg + Cy), the output signals for lines L5, L6. L7 and 

45 L8 are (Cy + G). (Ye + Mg) As a result, a solution for equation (2) can not be obtained for these lines. Similarly, 

while equation (3) is set up using (Cy + G) and (Ye + Mg). the output signals for lines LI. L2. L3 and L4 are (Cy + Mg), 
(Ye + G) As a result, a solution for equation (3) can not be obtained for these lines. 

[0023] As Is described above, a solution for equation (2) can be otrtained for the outputs for lines LI to L4, but can not 
be obtained for the outputs for lines L5 to L8. Likewise, a solution for equation (3) can be obtained for the outputs for 
so lines L5 to L8, but can not be obtained for tiie outputs for lines L1 to L4. 

[0024] Therefore, color difference signals CB and CR for the individual colors can be obtained only for pixel signals 
for two lines, although pixel signals are output for eight lines by the image pickup apparatus. That is, since luminance 
signal Y and color difference signals CB and CR can not be obtained unless pixel signals for four lines are enrployed. 
accordingly, vertical resolution is reduced. 

55 

SUMMARY OF THE INVENTION 

[0025] It is one objective of the present invention to generate an image signal that has a high resolution, both hori- 
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zontally and vertically. 

[0026] It is another objective of the present invention to efficiently acquire a color image signal having a high resolu- 
tion. 

[0027] It is an additional objective of the present invention to provide multiple modes, such as a mode for outputting 
5 a low-resolution image signal at a high speed and a mode for outputting a high-resolution image signal at a low speed, 
for an easy color display, for auto-focusing and for the automatic adjustment of the white balance. 
[0028] To achieve the above objectives, according to one aspect of the present invention, an image pickup apparatus 
comprises: 

10 a plurality of pixels arranged horizontally and vertically: and 

a color filter array for four colors arranged in the plurality of pixels, 

wherein the color filter array has a cyclic pattern of four lines x four columns, and 

wherein, in the cyclic pattern unit comprising four rows and four columns, colors of color filters on the same row dif- 
fer from each other and colors of the color filters in the same column differ from each other. 

IS 

[0029] According to one more aspect of the present invention, an image pickup apparatus comprises: 

a plurality of pixels arranged horizontally and vertically; and 
a color filter array of N colors (N is an integer) arranged in the plurality of pixels, 
20 wherein the color filter array Is so an^anged that luminance signals are generated from all the rows and all the col- 
umns. 

[0030] According to another aspect of the present invention, an image pickup apparatus comprises: 

25 a plurality of pixels arranged horizontally and vertically; and 

a color filter array of four colors arranged in the plurality of pixels, 

wherein the color filter array is so arranged that two color difference signals are generated by a cyclic pattern of two 
rows X two columns by using addition signals of pixels In the horizontal direction and by using addition signals of 
pixels in the vertical direction. 

30 

[0031] According to an additional aspect of the present invention, an image pickup apparatus comprises: 
a plurality of pixels arranged horizontally and vertically; 

a plurality of vertical output lines along which signals produced by the plurality of pixels are read; 
35 a plurality of storage means, provided along the vertical output lines, for the storage of the signals produced by the 
plurality of pixels; 

first addition means, provided along the vertical output lines, for adding together signals produced by pixels on the 
same row that are output by the plurality of storage means; 

second addition means, provided along the vertical output lines, for adding together signals produced by pixels in 
40 the same column that are output by the plurality of storage means; and 

a horizontal output line along which are read resultant signals produced by the first addition means and the second 
addition means. 

[0032] According to a further aspect of the present invention, an image pickup apparatus comprises: 

45 

a plurality of pixels arranged horizontally and vertically; and 

addition means for adding together pixels that are located adjacent to each other horizontally and/or vertically, while 
shifting the plurality of pixels by one pixel. 

50 [0033] According to one further aspect of the present invention, an image pickup apparatus comprises: 

a plurality of pixels arranged horizontally and vertically; 

readout means for reading out signals produced by the plurality of pixels as a unit, comprising a pixel block that is 
composed of P lines x Q columns (P and Q are integers), while shifting the plurality of pixels horizontally or/and 
55 Vertically by one pixel or predetermined number of pixels; and 

saving means for saving signals produced in an area that overlaps the next pixel block that is shifted the predeter- 
mined number of pixels away from the pixel block in the area of the pixel block that is read by the readout means, 
wherein the readout means employs the signals stored in the saving means to read a succeeding pixel block. 
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[0034] According to yet one more aspect of the present invention, a method for reading an image signal produced by 
an image pickup apparatus in which four color filters are disposed, comprises the step of: 

calculating A + B • C - D for signals A. B, C and 0 produced by pixels at which are positioned the four color filters. 
5 wherein pixels from which signals A and B are output are located adjacent to each other horizontally or vertically; 

and 

wherein the color filters have a cyclic pattern of four rows x four columns, and, in the cyclic pattern of four lines and 
four columns, colors of color filters on the same row differ from each other and colors of the color filters in the same 
column differ from each other. 

10 

[0035] According to yet another aspect of the present invention, a method for reading an image signal produced by 
an image pickup apparatus in which four color filters are disposed, comprises the step of: 

calculating A + B - C - D for signals A. B. C and D produced by pixels at which are positioned the four color filters. 
15 wherein pixels from which signals A and B are output are located adjacent to each other horizontally or vertically: 
and 

wherein the color filters have a cyclic pattern of four rows x four columns, and are so arranged that luminance sig- 
nals are generated from all the rows arxJ all the columns. 

20 [0036] According to yet ^n additional aspect of the present invention, a method for reading an image signal produced 
by an image pickup apparatus in which four color filters are disposed, comprises the step of: 

calculating A + B - C - D for signals A, B, C and D produced by pixels at which are positioned the four color filters, 
wherein pixels by which signals A and B are output are located adjacent to each other horizontally or vertically: and 
25 wherein the color filters are so arranged that two color difference signals are generated by a cyclic pattern of two 
rows X two columns by using addition signals of pixels in the horizontal direction and by using addition signals of 
pixels in the vertical direction. 

[0037] According to yet a further aspect of the present invention, an image processing system comprises: 

30 

an image pickup apparatus in which is mounted a color filter array for four colors; 

a compressor for compressing data; 

a decompressor for decompressing compressed data; and 

a color processor for at the least performing an adjustment for white balance or for y correction, 
35 wherein a signal from the image pickup apparatus is transmitted to the compressor without passing through the 
color processor, and a signal compressed by the compressor is decompressed by the decompressor, the resultant 
signal being transmitted to the color processor; 

wherein the color filter array has a cyclic pattern of four rows x four columns; and 

wherein, in the cyclic pattern of four lines and four columns, colors of color filters on the same row differ from each 
40 other and colors of the color fitters in the same column differ from each other. 

[0038] According to yet one further aspect of the present invention, an image processing system comprises: 

an image pickup apparatus in which is mounted a color filter array for N colors (N is an integer); 
45 a compressor for compressing data; 

a deconpressor for deconpressing compressed data; and 

a color processor for at the least performing an adjustment for a white balance or for y correction, 
wherein a signal from the image pickup apparatus is transmitted to the compressor without passing through the 
color processor, and a signal compressed by the compressor is decompressed by the decompressor, the resultant 
so signal being transmitted to the color processor; and 

wherein the color filter array is so arranged that luminance signals are generated from all the rows and all the col- 
umns. 

[0039] According to still one more aspect of the present invention, an image processing system comprises: 

55 

an image pickup apparatus in which is mounted a color filter array for N colors (N is an integer); 

a compressor for compressing data; 

a decompressor for decompressing compressed data; and 
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a color processor for at the least performing an adjustment for white balance or for y correction, 
wherein a signal from the image pickup apparatus is transmitted to the compressor without passing through the 
color processor, and a signal compressed by the compressor is decompressed by the decompressor, the resultant 
signal being transmitted to the color processor; and 
5 wherein the color filter array is so arranged that two color difference signals are generated for a cyclic pattern of two 

rows X two columns by using addition signals of pixels in the horizontal direction and by using addition signals of 
pixels in the vertical direction. 

[0040] Other objectives and features of the present invention will become apparent during the course of the explana- 
10 tion given while referring to the following specifications and drawings. 

[0041] With the above described an-angement. an image of high quality can be obtained. 

BRIEF DESCRIPTION OF THE DRAWINGS 

15 [0042] 

Fig. 1 is a diagram for explaining a conventional color filter array that has a cyclic pattern of two pixels horizontally 
and four pixels vertically; 

Fig. 2 is a diagram for explaining a conventional color filter array that has a cyclic pattern of two pixels horizontally 
20 and eight pixels vertically; 

Fig. 3 is a block diagram illustrating the arrangement of an image pickup apparatus according to a first embodiment 
of the present invention; 

Fig. 4 is a diagram for explaining an example array of color filters employed by the image pickup apparatus; 
Fig. 5 is a diagram for explaining another example array of color filters employed by the image pickup apparatus: 
25 Fig. 6 is a diagram for explaining an example array of color filters employed by an image pickup apparatus accord- 
ing to a second embodiment of the present invention; 

Fig. 7 is a diagram for explaining another example array of color filters employed by the image pickup apparatus; 
Fig. 8 is a diagram for explaining the circuit structure, according to a third embodiment of the present invention, of 
an image pickup apparatus that performs pixel signal reading method 1 of the first and the second embodiments; 
30 Fig. 9 is a diagram for explaining the processing performed by the image pickup apparatus having the above circuit 
structure; 

Fig. 10 is a diagram for explaining the circuit structure, according to a fourth embodiment of the present irrvention. 
of an image pickup apparatus that performs pixel signal reading method 1 of the first and the second embodiments; 
Fig. 1 1 is a diagram for explaining the processing performed by the image pickup apparatus having the above cir- 

35 cuit Structure; 

Fig. 12 is a diagram for explaining the circuit structure, according to a fifth embodiment of the present invention, of 
an image pickup apparatus that performs pixel signal reading method 1 of the first and the secorxj embodiments; 
Fig. 13 is a diagram for explaining the processing performed by the image pickup apparatus having the above cir- 
cuit structure; 

40 Fig, 1 4 is a diagram for explaining the circuit structure, according to a sixth embodiment of the present invention, of 
an image pickup apparatus that performs overlap reading; 

Fig. 15 is a diagram for explaining the processing performed by the image pickup apparatus having the above cir- 
cuit structure; 

Fig. 16 is a diagram for explaining a luminance signal and a color signal that are obtained from pixel signals when 
45 the overlap reading is not performed; 

Fig. 1 7 is a diagram for explaining a luminance signal and a color signal that ore obtained from pixel signals when 
the overlap reading is performed; 

Fig. 18 is a diagram for explaining an example circuit structure that better embodies the image pickup apparatus; 
Fig. 1 9 is a diagram for explaining the processing performed by the image pickup apparatus having the circuit struc- 
50 ture in Fig. 18; 

Fig. 20 is a diagram for explaining another example drcurt-structure that better embodies the image pickup appa- 
ratus; 

Fig. 21 is a diagram for explaining the processing performed by the image pickup apparatus having the circuit struc- 
ture in Fig. 20; 

55 Fig. 22 is a diagram for explaining the circuit structure that has functions of both the circuits shown in Figs. 1 8 arKl 
20; 

Fig. 23 is a diagram for explaining the processing performed by the image pickup apparatus having the circuit struc- 
ture in Fig. 22; and 
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Fig. 24 is a block diagram illustrating the arrangement of an image processing system according to a seventh 
embodiment of the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

5 

[0043] The preferred embodiments of the present invention will now be described while referring to the accompanying 
drawings. 

(First Embodiment) 

10 

[0044] The present Invention is applied, for example, to an image pickup apparatus 700 shown in Fig. 3. 
[0045] The image pickup apparatus 700 is provided In a digital still camera, etc.. and comprises: an image pickup unit 
710, for outputting a pixel signal obtained from an incident object light; and a luminance/color difference preparation unit 
720 for generating luminance signal Y and color difference signals CB and CR using pixel signals received from the 
15 image pickup unit 710. 

[0046] The image pickup unit 710 includes a color filter 71 1. a pixel unit 712 for receiving object light that passes 
through the color filter 71 1 . and a signal reading unit 713 for reading a pixel signal obtained at the pixel unit 712. The 
pixel signal read at the signal reading unit 713 is transmitted to the luminance/color difference preparation unit 720. 
[0047] The image pickup unit 710 employs, as the color filter 711. four complementary color filters for yellow (Ye), cyan 
20 (Cy). magenta (Mg) and green (G), which will be described later in detail. Therefore, the pixel unit 712 obtains four com- 
plementary color pixel signals Ye, Cy, Mg and G. These pixel signals are read by the pixel reading unit 713 and are 
transmitted to the luminance/color difference preparation unit 720. 

[0048] The luminance/color difference preparation unit 720 obtains luminance signal Y and color difference signals 
CB and CR by employing the pixel signals Ye. Cy. Mg and G received from the image pickup unit 710. The luminance 
25 signal Y, which is also used as an auto focus detection signal, and color difference signals CB and CR are used to dis- 
play images, at a low resolution, in a liquid crystal viewf inder of a digital still camera and to adjust the iris and the white 
balance of the camera. The image pickup unit 710 and the luminance/color difference preparation unit 720 may either 
be mounted on the same IC chip, or on separate IC chips. 

[0049] The most important feature of the above described image pickup apparatus is the image pickup unit 710. A 
30 specific explanation will now be given for the image pickup unit 710. 
[0050] First, the structure of the color filter 711 will be explained. 

[0051 ] In Fig. 4 is shown the filter arrangement (pattern) for the color filter (complementary color filter) 71 1 in Fig. 3. 
[0052] As is shown in Fig. 4. the color filter 711 is a filter array that has a cyclic pattern of four pixels horizontally and 
four pixels vertically In the thus arranged color filter 711 , on the first line L1 , starting at the left, color filters G1 . Yel . Cy2 
35 and Mg2 are arranged; on the second line L2, which is rotated two columns to the left relative to the first line LI . starting 
at the left, color filters Cy 1 , Mgl . G2 and Ye2 are arranged; on the third line L3. starting at the left, color filters Ye3, G3. 
Mg4 and Cy4 are arranged; and on the fourth line L4. which is rotated two columns to the left relative to the third line 
L3, starting at the left, color filters Mg3, Cy3. Ye4 and G4 are arranged. 

[0053] As is described above, the color filter 711 is so arranged that the color filters do not overlap on any line and 
40 their cyclic patterns of four pixels horizontally and four pixels vertically differ, and that the color filters do not overlap in 
any column and their cyclic patterns of four pixels horizontally and four pixels vertically differ. 
[0054] In the filter an^angement in Fig. 4, the color filters may be inverted from side to side or vertically 
[0055] The object light passes through the thus arranged color filter 71 1 and impinges on the light receiving face (not 
shown) of the pixel unit 712. The pixel unit 712 performs a photoelectric conversion to obtain a pixel signal that corre- 
45 spends to the volume of light received at each pixel on the light receiving face. In accordance with a signal reading 
method, which will be described later, the signal reading unit 713 reads a pixel signal obtained at the pixel unit 712 and 
transmits the pixel signal to the luminance/color difference preparation unit 720. The luminance/color difference prepa- 
ration unit 720 obtains luminance signal Y. blue color difference signal CB and red color difference signal CR by employ- 
ing pixel signals for areas having various sizes and shapes that were received from the signal reading unit 713. 
so [0056] An explanation will now be given for the pixel signal reading method used by the signal reading unit 713. and 
for the calculations performed by the luminance/color difference preparation unit 720 while using the pixel signal that is 
read using the signal reading method. 

[Signal reading method 1] 

55 

[0057] The signal reading unit 713 reads, from the pixel unit 712. a string of pixel signals: (G1 + Yel), (Cyl + Mg1). 
(Cy2 + Mg2), (G2 + Ye2), .... Then, from a pair (added signal) of adjacent pixel signals in the pixel signal string, the 
luminance/color difference preparation unit 720 acquires color difference signal CB by. for example, performing the fbl- 
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lowing calculations: 

CB1 = (G1 + Ye1) - (Cyl + Mgl) 

5 CB2 ^ -(Cy2 + Mg2) + (G2 + Ye2). 

[0058] The signal reading unit 713 also reads, from the pixel unit 712, a string of pixel signals: (G1 + Cy1), (Ye1 + 
Mg1). (Cy2 + G2). (Mg2 + Ye2) Then, from a pair of adjacent pixel signals in the pixel signal string, the lumi- 
nance/color difference preparation unit 720 acquires color difference signal CR by, for example, performing the following 
10 calculations: , 

CR1 =(G1 +Cy1)-(Ye1 +f^g1) 
CR2 = (Cy2 + G2) - (Mg2 + Ye 2). 

15 

[0059] According to signal reading method 1 , unlike the prior art there are no lines for which the calculation can not 
be preformed to obtain color signals CB and CR, and color difference signals CB and CR are each consistently 
obtained for two pixel signals, both horizontally and vertically. Therefore, a high resolution is acquired horizontally and 
vertically. 

20 

[Signal reading method 2] , 

[0060] Signal reading methods 2 to 5 are those whereby luminance signal Y can be output at a high resolution. These 
methods are appropriate for auto focusing that is performed with calculations that use only luminance signal Y 
25 [0061] According to signal reading method 2. the signal reading unit 713 reads from the pixel unit 712 a string of pixel 

signals: (G1 + Cyl + Ye3 + Mg3). (Ye1 + Mg1 + G3 + Cy3) To calculate luminance signal Y the luminance/cdor 

difference preparation unit 720 employs the pixel signal string for the equations: 

Y1 =G1 +Cy1 +Ye3 + Mg3 

30 

Y2 = Yel + Mg1 + G3 + Cy3. 

[0062] According to signal reading method 2, since one luminance signal Y is obtained horizontally for each pixel, a 
high horizontal resolution is obtained. The luminance signal Y generated using this method is an optimal auto focusing 
35 detection signal, especially when an object is one, such as a fine striped pattern, that has a high horizontal resolution. 

[Signal reading method 3] 

[0063] The signal reading unit 713 reads from the pixel unit 712 a string of pixel signals: (G1 + Cyl + Ye3 + Mg3). 

40 (Yel + Mgl + G3 + Cy3) To calculate luminance signal Y. luminance/color difference preparation unit 720 employs 

the pixel signal string for the equations: 

Y1 =(G1 +Cy1 + Ye3 + Mg3) + (Ye1 + Mgl +G3 + Cy3). 

45 [0064] According to signal reading method 3, since one luminance signal Y is otstained horizontally for each two pix- 
els, a level of the luminance signal Y becomes high. The luminance signal Y generated using this method is an optimal 
auto focusing detection signal, especially when an object is one, such as a fine striped pattern, that has a high horizon- 
tal resolution, and when the object is low luminance. 

50 [Signal reading method 4] 

[0065] The signal reading unit 713 reads from the pixel unit 712 a string of pixel signals: (G1 + Yel + Cy2 + Mg2), 
(CY1 + Mgl + G2 + Ye2). .... To calculate luminance signal Y, the luminance/color difference preparation unit 720 
employs the pixel signal string for the equations: 

55 

Y1 =Q1 + Yel +Cy2 + Mg2 
Y2 = Cyl + Mgl + G2 + Ye2. 
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[0066] According to signal reading method 4. since one luminance signal Y is obtained vertically for each pixel, a high 
vertical resolution is obtained. The luminance signal Y generated using this method is an optimal auto focusing detec- 
tion signal, especially when an object is one, such as a fine striped pattern, that has a high vertical resolution. 

[Signal reading method 5] 

[0067] The signal reading unit 713 reads from the pixel unit 712 a string of pixel signals: (G1 + Yel + Cy2 + Mg2). 
(Cyl + Mg1 + G2 + Ye2), ... To calculate luminance signal Y, the luminance/color difference preparation unit 720 
employs the pixel signal string for the equation: 

Y1 ={G1 +Ye1 + Cy2 + Mg2) + (Cyl +Mg1 +G2 + Ye2). 

[0068] According to signal reading method 5. since one luminance signal Y is obtained vertically for every two pixels, 
the level of luminance signal Y is increased. The luminance signal Y generated using this method is an optimal auto 
focusing detection signal, especially when an object is one, such as a fine striped pattern, that has a high horizontal 
resolution and a low luminance level. 

[Signal reading method 6] 

[0069] The signal reading unit 713 reads, from the pixel unit 712. a string of pixel signals: (Gl + Yel), (Cyl + K/lgl), 

(Cy2 + Mg2). {G2 + Ye2) Then, from a pair of adjacent pixel signals in the pixel signal string, the luminance/color 

difference preparation unit 720 acquires color difference signal CB by, for exannple, performing the following calcula- 
tions: 

CB1 = (G1 + Ye 1) - (Cy1 + Mgl) 

CB2 = -(Cy2 + Mg2) + (G2 + Ye2). 

[0070] The signal reading unit 713 also reads, from the pixel unit 712, a string of pixel signals: (Ye3 + Mg3). (G3 + 
Cy3). (Mg4 + Ye4), (Cy4 + G4). .... Then, from a pair of adjacent pixel signals in the pixel signal string, the lumi- 
nance/color difference preparation unit 720 acquires color difference signal CR by, for example, performing the following 
calculations: 

CR1 = -{Ye3 + Mg3) + (G3 + Cy3) 

CR2 = -(Mg4 + Ye4) + (Cy4 + G4). 

[0071] According to signal reading method 6. color signals can be obtained in accordance with the order of the color 
lines. This is an optimal method for use when an object is a moving picture. With this method an image signal can be 
output at a high speed because the number of signals that are read (the number of color signal pixels that are read) Is 
only half that of those that are read for the signal reading method 1 . 

[Signal reading method 7] 

[0072] The signal reading unit 713 reads, from the pixel unit 712. a string of pixel signals: (Gl + Yel), (Cyl + Mg1), 

(Cy2 + Mg2). (G2 + Ye2) Then, from a pair of adjacent pixel signals in the pixel signal string, the luminance/color 

difference preparation unit 720 acquires color difference signal CB by. for example, performing the following calcula- 
tions: 

CB1 = (Gl + Yel) - (Cyl + Mgl) 

CB2 = -(Cy2 + Mg2) + (G2 + Ye 2). 

[0073] The signal reading unit 713 also reads, from the pixel unit 712. a string of pixel signals: (Cy2 + G2). (Mg2 + 
Ye2), (Mg4 + Ye4). (Cy4 + G4) Then, from a pair of adjacent pixel signals In the pixel signal string, the lumi- 
nance/color difference preparation unit 720 acquires color difference signal CR by, for example, performing the following 
calculations: 
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CR1 = (Cy2 + G2) • (Mg2 + Ye 2) 
CR2 = -(Mg4 + Ye4) + (Cy4 + G4). 

5 [0074] Signal reading method 7, as well as signal reading method 6, is an optimal method for use when an object is 
a moving picture, and when this method is used, an image signal can be output at a high speed, 

[Signal reading method 8] 

10 [00751 Color difference signal CB is acquired in the same manner as is described in signal reading method 7. 

[0076] The signal reading unit 713 reads, from the pixel unit 712. a string of pixel signals: (Gl + CY1). (Yel + Mgl), 

(Ye3 + Mg3). (G3 + Cy3). Then, from a pair of adjacent pixel signals in the pixel signal string, the luminance/color 

difference preparation unit 720 acquires color difference signal CR by, for example, performing the following calcula- 
tions: 

IS 

CR1 = (Gl + Cyl) - (Yel + Mgl) 

CR2 = -(YeS + Mg3) + (G3 + CyS). 

20 [0077] Signal reading method 8. as well as signal reading methods 6 and 7, is an optimal method for use when an 
object Is a moving picture, and when this method is used, an image signal can be output at a high speed. 

[Signal reading method 9] 

25 [0078] Color difference signal CB is acquired in the same manner as is described in signal reading method 7. 

[0079] The signal reading unit 713 reads, from the pixel unit 712, a string of pixel signals: (Gl + Cyl). (Yel + Mgl). 

(Cy2 + G2), (Mg2 + Ye2) Then, from a pair of adjacant pixel signals in the pixel signal string, the luminance/color 

difference preparation unit 720 acquires color difference signal OR by, for example, performing the following calcula- 
tions: 

30 

CR1 =(G1 +Cy1)-(Ye1 +Mg1) 

CR2 = (Cy2 + G2) - (Mg2 + Ye 2). 

35 [0080] Signal reading method 9. as well as signal reading methods 6 to 8. is an optimal method for use when an object 
is a moving picture, and when this method is used, an image signal can be output at a high speed. Furthermore, a fea- 
ture of this method is that it can obtain color difference signals CB and CR by using pixel signals in the same area. 

[Signal reading methods 10 to13] 

40 

[0081] The signal reading unit 713 reads, from the pixel unit 712. a string of pixel signals: (Gl + Yel). (Cy1 + Mg1). 
(Ye3 + G3). (Mg3 + Cy3) Then, from a paii- of adjacent pixel signals in the pixel signal string, luminance/color dif- 
ference preparation unit 720 acquires color difference signal CB by. for example, performing the following calculations: 

45 CB1 =(G1 +Ye1)-{Cy1 +Mg1) 

CB2 = (Ye3 + G3) - (Mg3 + Cy3). 

[0082] Color difference signal CR is obtained in the same manner as is described in signal reading methods 6 to 9. 
so Signal reading methods 10 to 13. as well as signal reading methods 6 to 9. ore optimal methods for use when an object 
is amoving picture, and-when these methods are used, image signals can be output at high speeds. 

[Signal reading method 14] 

55 [0083] The signal reading unit 713 reads, from the pixel unit 712, a string of pixel signals: (Gl + Yel), (Cy1 + Mgl). . 
Then, from a pair of adjacent pixel signals in the pixel signal string, the luminance/color difference preparation unit 
720 acquires color difference signal CB by. for example, performing the following calculation: 
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CB1 =(G1 + Yel) -(Cyl +Mg1). 

[0084] The signal reading unit 713 also reads, from the pixel unit 712. a string of pixel signals: (Mg4 + Ye4), (Cy4 + 

G4) Then, from a pair of adjacent pixel signals in the pixel signal string, the luminance/color difference preparation 

5 unit 720 acquires color difference signal CR by. for example, performing the following calculation: 

CR1 = -(Mg4 + Ye4) + (Cy4 + G4). 

[0085] Signal reading method 14. as well as signal reading methods 6 to 13. is an optimal method for use when an 
10 object is a moving picture, and when this method is used, an image signal can be output at a high speed. In particular, 
since the number of signals that are road using this method (the necessary number of pixels that are read to generate 
a color difference signal) is only one quarter that of those that are read by signal reading method 1 . an Image signal can 
be output at a higher speed. 

IS [Signal reading method 15] 

[0086] Only the generation of a color difference signal has been explained in the signal reading methods 1 and 6 to 
14. A luminance signal can be generated by the following signal reading method 15. 

[0087] Specifically, the signal reading unit 713 reads, from the pixel unit 712. a string of pixel signals: (G1 + Yel), (Cyl 

20 + Mgl). (Cy2 + Mg2), (G2 .+ Ye2), (Ye3 + G3). (Mg3 + Cy3), (Mg4 + Cy4). (Ye4 + G4) Then, from a pair of adjacent 

pixel signals in the pixel signal string, the luminance/color difference preparation unit 720 acquires luminance signal Y 
by, for example, performing the following calculations: 

Y1 =(G1 + Yel) + (Cyl +Mg1) 

25 

Y2 = (Cy2 + Mg2) + (G2 + Ye2) 

Y3 = (Ye3 + G3) + (Mg3 + Cy3) 

30 Y4 = (Mg4 + Cy4) + (Ye4 + G4). 

[0088] According to signal reading method 15. luminance signal Y can be obtained horizontally and vertically for every 
two pixels. 

35 [Signal reading method 16] 

[0089] Only the generation of a color difference signal has been explained in the signal reading methods 1 and 6 to 
14. A luminance signal can also be generated by the following signal reading method 16. 

[0090] Specifically, the signal reading unit 713 reads, from the pixel unit 712. a string of pixel signals: (G1 + Cyl), (Yel 

40 + Mgl ). (Cy2 + G2). (Mg2 + Ye2), (Ye3 + Mg3), (G3 + Cy3). (Mg4 + Ye4). (Cy4 + G4) Then, from a pair of adjacent 

pixel signals in the pixel signal string, the luminance/color difference preparation unit 720 acquires luminance signal Y 
by. for example, performing the following calculations: 

Y1 =(G1 +Cy1) + (Ye1 +Mg1) 

45 

Y2 = (Cy2 + G2) + (Mg2 + Ye 2) 

Y3 = {Ye3 + Mg3) + (G3 + Cy3) 

50 Y4 = (Mg4 + Y€4) + (Cy4 + G4). 

[0091] According to signal reading method 16. luminancesignal Yean be obtained horizontally and vertically for every 
two pixels. 

[0092] In the above embodiment, the filter arrangement shown in Fig. 4 is employed for the color filter 71 1 used in the 
55 pixel unit 12. However, the above described signal reading methods 1 to 16 can be applied to a filter arrangement 
shown in Fig. 5 where the third line L3 and the fourth line L4 in the filter arrangement in Fig. 4 are exchanged. 
[0093] According to the signal reading methods 1 to 16. signals are read for the 4 x 4 or the 2 x 2 pixel block unit, but 
the unit Is not thus limited. Further, a pixel block to be read is not always closely adjacent to a pixel block that was pre- 
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viously read. These pixel blocks may be located at intervals defined by a predetermined block unit. With this arrange- 
ment, the number of pixels for signals to be read (the number of pixel signals read for color signals) can be reduced and 
the processing speed can be increased. 

[0094] For example, to output at a high speed signals having a lov^ resolution, in an 8 x 8 pixel block that includes C1 , 

C2 and C8 horizontally and L1 . L2 and LB vertically, color signal CR1 may be obtained from (C1 . L1), (CI . L2). 

(C2 L1). (C2. L2): color signal CB1 may be obtained from (C3. L3). (C3. L4), (C4. L3). (C4. L4); color difference signal 
CR2 may be obtained from (C5. L5). (C5. L6). (C6. L5). (C6. L6): and color signal CB2 may be obtained from (C7. L7). 
(C7. L8). (C8. L7). (C8. L8). 



(Second Embodiment) 

[0095] In a second embodiment, for the image pickup apparatus 700 shown In Fig. 3. suppose that the arrangement 
of the color filter 71 1 shown in Fig. 6 is employed. 

[0096] As is shown in Fig. 6. the color filter 71 1 is so arranged that it has a cyclic pattern of four pixels honzontally 
and four pixels vertically. In the thus arranged color filter 7 1 1 . on the first line L1 . starting at the left, color filters G1 , Yel , 
Mg2 and Cy2 are arranged; on the second line L2. which is rotated two columns to the left relative to the first line LI. 
starting at the left, color filters Mgl . Cyl . G2 and Ye2 are arranged; on the third line L3. which is rotated one column to 
the left relative to the first line LI . starting at the left, color filters Cy3, G3. Ye4 and Mg4 are arranged; and on the fourth 
line L4. which is rotated three columns to the left relative to the first line LI. starting at the left, color filters YeS. Mg3. 

Cy4 and G4 are arranged. ...... , x-u 

10097] As is described above, in the cyclic pattern of four pixels horizontally and four pixels vertcally in the color filter 
71 1 , on all the lines and in ail the columns, all of which differ from each other. 
[0098] In the arrangement in Fig. 6. the color filters may be inverted from side to side or vertically. 
[0099] As well as in the first embodiment, object light, which is transmitted through the color filter 71 1 that has the 
above described array arrangement, impinges on the light receiving face of the pixel unit 712. which performs a photo- 
electric conversion of the light to obtain a pixel signal that corresponds to the volume of light received at each pixel on 
the light receiving face. Using a reading method which will be described later, the signal reading unit 713 reads the pixel 
signal obtained by the pixel unit 712 and then transmits it to the luminance/color difference preparation unit 720. The 
luminance/color difference preparation unit 720 obtains luminance signal Y. blue color difference signal CB and red 
color difference signal CR using pixel signals for various shaped areas that are received from the signal reading unit 
713. 

[01 00] An explanation will now be given for the method used by the signal reading unit 71 3 in this embodiment to read 
a pixel signal, and the calculations performed by the luminance/color difference preparation unit 720 using a pixel signal 
that is read in accordance with the reading method. 

[0101] Since the operation performed by the image pickup apparatus 700 in this embodiment is the same as that in 
the first embodiment, no explanation will be given, and only the structure differences will be specifically described. 



[Signal reading method 21] 

[0102] The signal reading unit 713 reads from the pixel unit 712 a string of pixel signals: (G1 + Mgl + Cy3 -i- Ye3). 

(Yel + Cyl + G3 + Mg3), To calculate luminance signal Y. luminance/color difference preparation unit 720 employs 

the pixel signal string for the equations: 

Y1 = G1 + Mgl + Cy3 + YeS 



Y2 = Yel +Cy1 +G3 + Mg3 

[01 03] According to signal reading method 21 . since one luminance signal Y is obtained horizontally for each pixel, a 
high horizontal resolution is obtained. The luminance signal Y generated using this method is an optimal auto focusing 
detection signal, especially when an object is one. such as a fine striped pattern, that has a Wgh horizontal resolution. 



[Signal reading method 22] 

[0104] The signal reading unit 713 reads from the pixel unit 712 a string of pixel signals: (G1 + Mgl + Cy3 + Ye3). 

(Yel + Cyl + G3 + Mg3) To calculate luminance signal Y. luminance/color difference preparation unit 720 employs 

the pixel signal string for the equations: 

Y1 = (G1 + Mgl + CyS + YeS) + (Yel + Cyl + GS + MgS). 
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[0105] According to signal reading method 22. since one luminance signal Y is ot>tained horizontally for each two pix- 
els, a level of the luminance signal Y becomes high. The luminance signal Y generated using this method is an optimal 
auto focusing detection signal, especially when an object is one. such as a fine striped pattern, that has a high horizon- 
tal resolution and when the object is low luminance. 

5 

[Signal reading method 23] 

[0106] The signal reading unit 713 reads from the pixel unit 712 a string of pixel signals: (G1 + Ye1 + Mg2 + Cy2). 

(Mgl + Cyl + G2 + Ye2) To calculate luminance signal Y, the luminance/color difference preparation unit 720 

10 employs the pixel signal string for the equations: 

Y1 =01 +Ye1 +Mg2 + Cy2 

Y2 = Mgl + Cyl + G2 + Ye2. 

15 

[0107] According to signal reading method 23. since one luminance signal Y is obtained vertically for each pixel, a 
high vertical resolution is obtained. The luminance signal Y generated using this method is an optimal auto focusing 
detection signal, especially when an object is one. such as a fine striped pattern, that has a high vertical resolution. 

20 [Signal reading method 24] 

[0108] The signal reading unit 713 reads from the pixel unit 712 a string of pixel signals: (G1 + Ye1 + Mg2 + Cy2), 

(Mgl + Cyl + G2 + Ye2) To calculate luminance signal Y, the luminance/color difference preparation unit 720 

employs the pixel signal string for the equation: 

25 

Y1 = (G1 + Ye 1 + Mg2 + Cy2) + (Mgl + Cyl + G2 + Ye2). 

[01 09] According to signal reading method 24. since one luminance signal Y is obtained vertically for every two pixels, 
the level of luminance signal Y is increased. The luminance signal Y generated using this method is an optimal auto 
30 focusing detection signal, especially when an object is one. such as a fine striped pattern, that has a high vertical res- 
olution and a low luminance level. 

[Signal reading method 25] 

35 [0110] The signal reading unit 713 reads, from the pixel unit 712, a string of pixel signals: (G1 + Yel), (Mgl + Cyl), 
(Mg2 + Cy2). (G2 + Ye2). .... Then, from a pair of adjacent pixel signals in the pixel signal string, the luminance/color 
difference preparation unit 720 acquires color difference signal CB by, for example, performing the following calcula- 
tions: 

40 CB1 = (G1 + Ye 1) - (Mgl + Cyl) 

CB2 = -(Mg2 + Cy2) + (G2 + Ye2). 

[0111] The signal reading unit 713 also reads, from the pixel unit 712, a string of pixel signals: (Cy3 + G3). (Ye3 + 
45 Mg3). (Ye4 + Mg4). (Cy4 + G4) Then, from a pair of adjacent pixel signals in the pixel signal string, the lumi- 
nance/color difference preparation unit 720 acquires color difference signal CR by. for example, performing the following 
calculations: 

CR1 = (Cy3 + G3) - (Ye3 + Mg3) 

so 

CR2 = -(Ye4 + Mg4) + (Cy4 + Q4), 

[0112] According to signal reading method 25, color difference signals can be obtained in accordance with the order 
of the color lines. This is an optimal method for use when an object is a moving picture. With this method an image sig- 
55 nal can be output at a high speed because the number of signals that are read (the number of color signal pixels that 
are read) is only half that of those that are read for all the pixels. 
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[Signal reading method 26] 

[0113] The signal reading unit 713 reads, from the pixel unit 712. a string of pixel signals: (G1 + Yel). (Mg1 + Cyl). . 
Then, from a pair of adjacent pixel signals in the pixel signal string, the luminance/color difference preparation unit 
5 720 acquires color difference signal CB by. for example, performing the following calculations: 

CB1 =(G1 +Ye1)-(Mg1 +Cy1)- 

[0114] The signal reading unit 713 also reads, from the pixel unit 712. a string of pixel signals: (Ye4 + Mg4). (Cy4 + 

10 G4) Then, from a pair of adjacent pixel signals in the pixel signal string, the luminance/color difference preparation 

unit 720 acquires color signal CR by. for example, performing the following calculations: 

CR1 = (Ye4 + Mg4) - (Cy4 + G4). 

15 [0115] Signal reading method 26. as well as signal reading method 25. is an optimal method for use when an object 
is a moving picture, and when this method is used, an image signal can be output at a high speed. Further, an image 
signal can be output at a high speed because the number of signals that are read is only half that of those that are read 
for all the pixels. 

20 [Signal reading method 27] 

[0116] Only the generation of a color signal has been explained in the signal reading methods 25 and 26. A luminance 
signal can be generated by the following signal reading method 27, 

[0117] Specifically, the signal reading unit 713 reads, from the pixel unit 712. a string of pixel signals: (G1 + Yel). (Mgl 

25 + Cyl). (Mg2 + Cy2). (G2 + Ye2), (Cy3 + G3). (Ye3 + Mg3), (Ye4 + Mg4). (Cy4 + G4) Then, from a pair of adjacent 

pixel signals in the pixel signal string, the luminance/color difference preparation unit 720 acquires luminance signal Y 
by. for exanrple, performing the following calculations: 

Y1 = (G1 + Ye 1) + (Mgl + Cyl) 

30 

Y2 = (Mg2 + Cy2) + (G2 + Ye2) 

Y3 = (Cy3 + G3) + (Ye3 + Mg3) 

35 Y4 = (Ye4 + Mg4) + {Cy4 + G4). 

[0118] According to signal reading method 27. luminance signal Y can be obtained horizontally and vertically for every 
two pixels. 

40 [Signal reading method 28] 

[0119] Only the generation of a color signal has been explained in the signal reading methods 25 and 26. A luminance 
signal can also be generated by the following signal reading method 28. 

[0120] Specifically, the signal reading unit 713 reads, from the pixel unit 712, a string of pixel signals: (Gl + Mgl). 

45 (Yel + Cyl). (Mg2 + G2). (Cy2 + Ye2). (Cy3 + Ye3). (G3 + Mg3). (Ye4 + Cy4). (Mg4 + G4) Then, from a pair of 

adjacent pixel signals In the pixel signal string, the luminance/color difference preparation unit 720 acquires luminance 
signal Y by. for example, performing the following calculations: 

Y1 = (Gl + Mgl) + (Yel + Cyl) 

so 

Y2 = (Mg2 + G2) + (ey2 + Ye2) - 

Y3 = (Cy3 + Ye3) + (G3 + Mg3) 

55 Y4 = (Ye4 + Cy4) + (Mg4 + G4). 

[01 21 ] According to signal reading method 28. luminance signal Y can be obtained horizontally and vertically for every 
two pixels. 
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[0122] In the above embodiment, the filter arrangement shown in Fig. 6 Is employed for the color filter 71 1 used in the 
pixel unit 12. However, the above described signal reading methods 21 to 28 can be applied to a filter arrangement 
shown in Fig. 7 where the third line L3 and the fourth line L4 in the filter arrangement in Fig. 6 are exchanged. 
[0123] According to the signal reading methods 21 to 26. signals are read for the 4 x 4 pixel block unit, but the unit is 
5 not thus limited. Further, a pixel block to be read is not always closely adjacent to a pixel block that was previously read. 
These pixel blocks may be located at intervals defined by a predetermined block unit. With this arrangement, the 
number of pixels for signals to be read (the number of pixel signals read for color signals) can be reduced and the 
processing speed can be increased. 

10 (Third Ennbodiment) 

[0124] In a third embodiment, a CMOS sensor, for example, is employed as the image pickup apparatus in Fig. 2. In 
this case, the following circuit structure can be employed to perform signal reading methods 1 to 28 in the first and the 
second embodiments. 

15 [01 25] In Fig. 8 is shown the circuit structure of the image pickup apparatus 700 (hereinafter referred to as "the CMOS 
sensor 700"). 

[0126] The CMOS sensor 700 comprises: a first output system for outputting a difference between an average value 
for light quantities received (detected light quantities) at two pixels (photo detectors) that are adjacent vertically and an 
average value for the light quantities detected by two photo detectors In the next column that are adjacent horizontally; 
20 and a second output system for outputting a difference between an average value for light quantities detected by two 
photo detectors that are adjacent horizontally and an average value for light quantities detected by two photo detectors 
on the next line that are adjacent horizontally. With this arrangement, the CMOS sensor 700 can perform reading 
method 1 . 

[0127] Specifically in Fig. 8. first, a vertical scanning circuit 1 generates enat>le signals that are rendered active in 
25 order to vertically enable control signals for the individual lines, and then photodiodes 100, which are light detectors for 
converting incident light into charges, generate charges that are transmitted by transmission transistors 101 to floating 
diffusion areas 102, wherein the charges generated by the photo detectors 100 are temporarily stored. 
[0128] Reset transistors 103. which discharge charges accumulated at the gates of amplifier transistors 104. are pro- 
vided as are switch transistors 121 and constant current transistors 112. The constant current is determined by a volt- 
30 age applied at a terminal 7. 

[01 29] Transistors 1 05 discharge the charges on capacitors 1 09, 1 1 0. 1 1 7 and 118; distribution transistors 1 06 con- 
nect the sources of the amplifier transistors 104 and the capacitors 109; and distribution transistors 107 connect the 
sources of the amplifier transistors 104 and the capacitors 110. 

[0130] The capacitors 109 and 1 10 function as line memories that are charged by a voltage supplied by the amplifier 
35 transistors 104. 

[0131] Averaging transistors 108 control the averaging of the charges accumulated on the capacitors 109 and the 
charges accumulated on the capacitors 110; and switch transistors 111 transmit voltages on the capacitors 1 09, which 
serve as line memories, to a buffer 123 provided at the preceding stage of a differential amplifier 122. 
[0132] The differential amplifier 122 amplifies a difference between the voltage of the capacitor 109 and the voltage 
40 of the capacitor 1 09*. 

[01 33] Switch transistors 113 connect the sources of the amplifier transistors 1 04 and the capacitors 117, and switch 
transistors 114 connect the sources of the amplifier transistors 104 and the capacitors 118. 

[0134] The capacitors 117 and 118 serve as line memories that are charged by a current supplied by the sources for 
the amplifier transistors 1 04, and switch transistors 115 control the averaging of the charges accumulated on the capac- 
45 itors 1 1 7 and the charges accumulated on the capacitors 1 1 T. 

[0135] Switch transistors 116 control the averaging of the charges accumulated on the capadtors 118 and the 
charges accunnulated on the capacitors 1 18'. Switch transistors 1 19 transmit the voltages on the capacitors 117. which 
are line memories, to a buffer 128 at the preceding stage of a differential amplifier 127. 

[0136] The differential amplifier 127 amplifies a difference between the voltage on the capacitor 117 and the voltage 
so on the capacitor 1 1 8'. 

[0137] The above descried constant-current transistors 1 12 are activated for each line, and are paired with the ampli- 
fier transistors 104 to form amplifiers. 

[0138] Fig. 9 is a timing chart showing the operating timings for the CMOS sensor 700 in Fig. 8. The processing per- 
formed by the CMOS sensor 700 will now be described while referring to Figs. 8 and 9. 
55 [0139] First, at time T201 the level of a pulse input at a terminal 1 1 is HIGH. In this situation, when pulses input to 
terminals 30. 3 1 , 50 and 51 go HIGH, the capacitors 1 09, 1 1 0. 1 1 7 and 1 1 8, which serve as line memories, are reset 
to the initial potential. Further, when a start pulse for the vertical scanning circuit 1 input at a terminal 2 and a scan pulse 
input at a terminal 3 go HIGH, the vertical scanning circuit 1 begins scanning and selects the first line (Rl). Since the 
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HIGH pulse is input at a terminal 8, the floating diffusion area In the pixel unit Is reset. 

[01401 At time T202 the reset pulse input at the terminal 8 goes LOW (is dropped). Thus, the floating diffusion areas 
of pixels on the first line are set to the electrically floating state. 

[0141] Next, when at time T203 the pulse input at the terminal 9 goes HIGH, the charges are transmitted from the 
photo detectors on the first line to the floating diffusion areas. 

[0142] When at time T204 pulses input at the terminals 10. 30 and 50 go HIGH, a voltage that is proportional to the 
quantity of the light detected by the photo detector on the first line is read by the amplifier transistor 104 for the capac- 
itors 109 and 117. 

[0143] Then, at time T205 the vertical scan pulse input to the terminal 3 goes LOW (is dropped). 

[0144] When at time T206 the vertical pulse input at the terminal 3 goes HIGH again (rises), the second line (R2) is 

selected 

[0145] When at time T207 the reset pulse input at the terminal 8 goes LOW (is dropped), the floating diffusion areas 
of pixels on the second line are set to the electrically floating state. 

[0146] When at time T208. as well as at time T203, the pulse input at the terminal 9 goes HIGH, charges are trans- 
mitted from the photo detectors on the second line to the floating diffusion areas. 

[0147] Also at time T209. as well as time T204. the pulses input at the terminals 10. 31 and 51 go HIGH, and a voltage 
that is proportional to the quantity of the light detected by each photo detector on the second line is read by the amplifier 
transistor 1 04 for the capacitors 1 1 0 and 1 1 8 for the second line. 

[0148] When at time T210 the pulses input at the terminals 40, 60 and 61 go HIGH, the charges accumulated on the 
capacitors 117, which serve as line memories, are averaged. 

[0149] At time T21 1 a horizontal scanning circuit 4 is activated, and horizontally transmits the averaged voltage to the 
differential amplifiers 122 and 127. in order. 

[0150] Then, the differential amplifiers 122 and 127 output blue color signal CB and red color signal CR. 
[0151] In addition, luminance signal Y is also obtained when the output at terminal 70. 71. 80 or 81 is added to an 
adder (not shown) that is constituted by an operational amplifier. Furthermore, when the charges detected by the photo 
detectors for all the lines are temporarily stored in the capacitors 109 without being averaged by the averaging transistor 
108. the output for each pixel on every odd line can be obtained from the terminal 71 . At the same time, the output for 
each pixel on every e/en line can be obtained from the terminal 70. 

(Fourth Embodiment) 

[0152] In the third embodiment, the circuit structure shown in Fig. 8 is employed for the CMOS sensor 700. In a fourth 
embodiment, the structure shown in Fig. 10, for example, is employed. 

[0153] The same reference numerals as are used in Fig. 8 are also used to denote corresponding or identical com- 
ponents of the circuit structure in Fig. 10 and no detailed explanation for them will be given. 

[0154] The CMOS sensor 700 includes an output system for outputting the overage of the light quantities detected by 
two photo detectors that are adjacent horizontally, or the average of the light quantities detected by four photo detectors 
that are adjacent horizontally. With this circuit arrangement, the CMOS sensor 700 can perform signal reading methods 
4 and 23. 

[0155] Specifically, in Fig. 10. a switch transistor 301 controls the averaging of the charges accumulated on a capac- 
itor 1 09 and the charges accumulated on a capacitor 1 09'. A switch transistor 302 controls the averaging of the charges 
accumulated on a capacitor 110 and the charges accumulated on a capacitor 1 10'. 

[0156] A switch transistor 301' controls the averaging of the charges accumulated on a capacitor 109" and the 
charges accumulated on a capacitor 109'". A switch transistor 302' controls the averaging of the charges accumulated 
on a capacitor 1 10" and the charges accumulated on a capacitor 1 10"'. 

[0157] A switch transistor 303 controls the averaging of the charges accumulated on the capacitor 109' and the 
charges accumulated on the capacitor 109". A switch transistor 304 controls the averaging of the charges accumulated 
on the capacitor 110* and the charges accumulated on the capacitor 110 ". 

[01 58] When the switch transistors 301 , 301 ' and 303 interact with each other, they average the charges accumulated 
on the capacrtors .109. 109'. 109" and 109"'. That is. when the switch transistor 303 is turned on, for ©cample, after or 
at the same time as the switch transistors 301 and 30i;.are turned.on, tbe^ transistors average the charges accumu: 
lated on the capacitors 109. 109*, 109" and 109'". 

[01 59] When the switch transistors 302. 302' and 304 interact with each other, they average the charges accumulated 
on the capacitors 1 10. 1 10'. 1 10" and 110'". That is, when the switch transistor 304 is turned on after or at the same 
time the switch transistors 302 and 304' are turned on. these transistors average the charges accumulated on the 
capacitors 110. 110', 110" and 110"'. 

[0160] Fig. 1 1 is a timing chart showing the operating timings for the CMOS sensor 700 in Fig. 10. The processing 
performed by the CMOS sensor 700 will now be described while referring to Figs. 10 and 1 1 . 
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[0161] First, when at time T401 a start pulse for the vertical scanning circuit 1 input at a terminal 2 and a vertical scan 
pulse input at a terminal 3 go HIGH, the vertical scanning circuit 1 begins scanning and selects the first line (R1). Since 
the reset pulse input at a terminal 8 is HIGH, the floating diffusion area in the pixel unit is reset. 
[0162] At time T402 the reset pulse input at the terminal 8 goes LOW (is dropped). Thus, the floating diffusion areas 
5 of pixels on the first line are set to the electrically floating state. 

[01631 Next, when at time T403 the pulse input at the terminal 8 goes HIGH, the charges are transmitted from the 
photo detectors on the first line to the floating diffusion areas. 

[0164] When at time T404 pulses input at the terminals 10 and 50 go HIGH, a voltage that is proportional to the light 
quantity detected by the photo detector on the first line is read for the capacitor 109 by the amplifier transistor 104. 
10 [0165] Then, at time T405 the vertical scan pulse input to the terminal 3 goes LOW (is dropped). 

[0166] When at time T406 the vertical pulse input at the terminal 3 goes HIGH again (rises), the second line (R2) is 
selected. 

[0167] When at time T407 the reset pulse input at the terminal 8 goes LOW (is dropped), the floating diffusion areas 
of pixels on the second line are set to the electrically floating state. 
IS [0168] When at time T408. as well as at time T403, the pulse input at the terminal 9 goes HIGH, charges are trans- 
mitted from the photo detectors on the second line to the floating diffusion areas. 

[0169] Also at time T409. as well as time T404, the pulses input at the terminals 10 and 51 go HIGH, and a voltage 
that is proportional to the light quantity detected by each photo detector on the second line is read for the capacitor 1 10 
by the amplifier transistor 104 for the second line. 
20 [0170] When at time T41 0 the pulses input at terminals 60. 61 , 90 and 91 go HIGH, the charges accumulated on the 
capacitors 109. 109'. 109" and 109". and the charges accumulated on the capacitors 110, 110'. 110" and 110'" are 
averaged in the line memories. 

[0171] At time T41 1 a horizontal scanning circuit 4 is activated that horizontally transmits the averaged voltage. 
[0172] Since the purpose is the output of luminance signal Y. in the circuit arrangement in Fig. 10 provided for the 
25 terminal 16 is only one output terminal of the CMOS sensor 700 system. However, as well as the structure shown in 
Fig. 8. a plurality of terminals (output lines) may be provided for the CMOS sensor 700 to obtain color difference signals 
CB and CR. 

(Fifth Embodiment) 

30 

[01 73] In the third embodiment, the circuit structure shown in Fig. 8 is employed for the CMOS sensor 700. In the fifth 
emtXKllment, the arrangement shown in Fig. 12 is employed. 

[0174] The same reference numerals as are used in Fig. 8 are also used to denote corresponding or identical com- 
ponents in the structure in Fig. 12, and no detailed explanation for them will be given, 
35 [01 75] The CMOS sensor 700 includes an output system for outputling the average of the light quantities detected by 
two photo detectors that are adjacent vertically, or the average of light quantities detected by four photo detectors that 
are adjacent vertically. With this circuit arrangement, the CMOS sensor 700 can perform signal reading methods 2 and 
21. 

[01 76] Specifically, in Fig. 12. distribution transistors 501 . 502, 503 and 504 transmit to corresponding capacitors 508. 

40 509. 510 and 51 1 a current that is received from a transistor 104. 

[0177] The capacitor 508 accumulates charges at photodetectors on the first line (R1); the capacitor 509 accumulates 
charges at photodetectors on the second line (R2); the capacitor 510 accumulates charges at photodetectors on the 
third line (R3); and the capacitor 51 1 accumulates charges at photodetectors on the fourth line (R4). 
[0178] A switch transistor 505 controls the averaging of the charges accumulated on the capacitor 508 and the 

45 charges accumulated on the capacitor 509; a switch transistor 506 controls the averaging of the charges accumulated 
on the capacitor 509 and the charges accumulated on the capacitor 510; and a switch transistor 507 controls the aver- 
aging of the charges accumulated on the capacitor 510 and the charges accumulated on the capacitor 51 1 . 
[0179] When the switch transistors 505. 506 and 507 interact with each other, they average the charges accumulated 
on the capacitors 508. 509, 510 and 51 1 . That is. when the switch transistor 506 is turned on after or at the same time 

so as the switch transistors 505 and 507 are turned on. these transistors average the charges accumulated on the capac- 
itors 508. 509. 510 and 51 1 . 

[0180] Fig. 13 is a timing chart showing the operating timings for the CMOS sensor 700 in Fig. 12. The processing 
performed by the CMOS sensor 700 will now be described while referring to Figs. 12 and 13. 

[0181] First, when at time T601 a start pulse for the vertical scanning drcuit 1 input at a terminal 2 and a vertical scan 
55 pulse input at a terminal 3 go HIGH, the vertical scanning circuit 1 begins scanning and selects the first line (R1 ). Since 
the reset pulse input at a terminal 8 is HIGH, the floating diffusion area in the pixel unit is reset. 
[0182] At time T602 the reset pulse input at the terminal 8 goes LOW (is dropped). Thus, the floating diffusion areas 
of pixels on the first line are set to the electrically f bating state. 
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[0183] Next, when at time T603 the pulse input at the terminal 8 goes HIGH, the charges are transmitted from the 
photo detectors on the first line to the floating diffusion areas. 

[0184] When at time T604 pulses input at the terminals 10 and 30 go HIGH, charges that are proportional to the light 
quantities detected by the photodetectors on the first line are accumulated on the capacitors 508. 
5 [0185] Then, at time T605 the vertical scan pulse input to the terminal 3 goes LOW (is dropped). 

[0186] When at time T606 the vertical pulse input at the terminal 3 goes HIGH again (rises), the second line (R2) is 
selected. 

[0187] When at time T607 the reset pulse input at the terminal 8 goes LOW (is dropped), the floating diffusion areas 
of pixels on the second line are set to the electrically floating state. 
10 [0188] When at time T608, as well as at time T603. the pulse input at the terminal 9 goes HIGH, charges are trans- 
mitted from the photo detectors on the second line to the floating diffusion areas. 

[0189] Also at time T609. as well as at time T604, the pulses input at the terminals 1 0 and 31 go HIGH, and charges 
that are proportional to the light quantities detected by photodetectors on the second line are accumulated on the 
capacitors 509. 

15 [0190] Similarly, at time T610 the pulses input at the terminals 10 and 32 go HIGH, and charges that are proportional 
to the light quantities detected by photodetectors on the third line are accumulated on the capacitors 510. 
[0191] Further, at time T61 1 the pulses input at the terminals 10 and 33 go HIGH, and charges that are proportional 
to the light quantities detected by photodetectors on the fourth line are accumulated on the capacitors 51 1 
[0192] When at time T612 the pulses input at the terminals 40 and 41 go HIGH, the charges accumulated on the 

20 capacitors 508, 509, 510 and 51 1 are averaged in the line memory. 

[01 93] At time T61 3 the horizontal scanning circuit 4 is activated to horizontally output, in order, the averaged voltage. 
Therefore, a voltage that is proportional to the average of the light quantities detected by the photodetectors on the f irst 
to the fourth lines (R1, R2, R3 and R4) is output in the direction of the columns. 

[0194] Since the switch transistor 506 is not used to average the charges in the circuit structure shown in Fig, 12. the 
25 average value for the first column (CI) and the second column (C2) can be obtained from the output terminal 70. the 
average value for the third column (C3) and the fourth column (C4) can be obtained from the output terminal 71 , and a 
difference between the average value for the first column (CI) and the second column (C2) and the average value for 
the third column (C3) and the fourth column (C4) can be obtained from the output terminal 72. 
[01 95] Furthermore, in the processing performed by the CMOS sensor 700 that was explained while referring to Figs. 
30 8 to 1 3, a reset voltage for a floating diffusion area may be read to another line memory before a charge (a light signal) 
at a pixel is read. A variance in an output voltage, which is caused by a variance in the threshold voltages of the tran- 
sistors 104, can be removed by obtaining a difference between the reset voltage and the light signal. Therefore, since 
a noise due to such a variance is not included in signals that correspond to light quantities detected by the photodetec- 
tors, signals having a high S/N ratio can be obtained. 
35 [01 96] The vertical and horizontal scanning may be performed for each block, or intermittently for every multiple block 
As a result, a more compressed signal can be otstained. 

(Sixth Embodiment) 

40 [0197] In the above described embodiments, to read signals for each pixel block, a pixel block to be read must be 
closely adjacent to a preceding pixel block that has been read. In this embodiment, a pixel block to be read is shifted, 
for example, one pixel away from a preceding pixel block that has been read (overlapping reading). 
[0198] Fig. 14 is a diagram showing the outline according to this embodiment of the most characteristic circuit struc- 
ture of the image pickup unit 710, of the image pickup apparatus 700 in Fig. 3, for reading signals every four pixel 

45 t)locks. Fig. 13 is a timing chart of the operating timings for the individual sections of the image pickup unit 710. 

[0199] As is shown in Figs. 14 and 15. when the image pickup unit 710 receives gate pulse at the timing at which 
vertical scan pulse is provided, pixel signal read (a signal Y12 is read in the same manner), and is stored in 
memory capacitor C^. When gate pulse S2 is received at the timing at which vertical scan pulse V2 is provided, pixel 
signal Y21 is read (a signal Y22 is read in the same manner), and is stored in memory capacitor C2. 

50 [0200] Then, upon receiving gate pulse H^ . pixel signals Yi 1 and Y21 are read from memory capacitor Ci . 

[0201] Pixel signals Y12 and Y22 are read in the samemanner. And pixel signaLY^^ is stored on memory capacitor 
C3. pixel signal Y12 is stored on memory capacitor C4. pixel signal Y21 is stored on memory capacitor C5. and pixel sig- 
nal Y22 is stored on memory capacitor Ce- 

[0202] When gate pulse T^ is provided at time ti . pixel signals Yi 1. Y12. Y21 and Y22. which are stored on the memory 
55 capacitors C3 to Cq, are output in parallel and at the same time. 

[0203] When at time ta gate pulse Tg is received, pixel signals Y^g Y^g. Y23 and Y22 for one blocK which are shifted 
horizontally one pixel, are output in parallel. In this case, pixel signals Y^g ^"^1 Y22 are output by memory capacitors C4 
andCe- 
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[0204] As in described above, according to this embodiment, pixel signals Y^2 ^nd Y22, which are stored in memory 
capacitors C4 and Cg during the reading of the preceding pixel block B1, i.e., signals obtained from pixels that exist in 
the portion wherein pixel blocks B1 and B2 overlap, are read for the succeeding pixel block 82. At this time, to road sig- 
nals (or each pixel block, the succeeding pixel block 82 that is to be read is horizontally shifted one pixel away from pre- 
5 ceding pixel block 81 . 

[0205] With this arrangement, the following effects can be obtained. 

[0206] In the first to fifth embodiments, as is shown in Fig. 1 6. pixel block B2\ which Is to be read next, is closely adja- 
cent to pixel block 8V. which was read previously Therefore, the pixel signals that are obtained are luminance signal Y 
and color signals CB and CR for every other pixel horizontally or vertically in the pixel unit. In the sixth embodiment, as 
10 is shown in Fig. 17. pixel block 82 to be read next overlaps the preceding pixel block 81, so that the pixel signals 
obtained are luminance signals Y and color signals CB and CR that correspond to individual horizontal pixels in the 
pixel unit. Therefore, the horizontal resolution can be doubled. 

[0207] In addition, two (see an-ows in Fig. 1 4) of the four capacitors C3. C4. C5 and Ce are used as storage means for 
storing pixels that were previously read, and the pixel signals stored therein are output as pixel signals for a pixel block 
15 to be read next. As a result, without an external memory being required, pixel signals can be obtained for each pixel 
block that has been shifted one pixel. 

[0208] Further, since the output for each pixel block that has been shifted one pixel is obtained inside the Image pickup 
unit 710 (in the same device), the signals can be output at a high speed. 

[0209] Since a 2 x 2 pixel block is employed as the unit to be read, two of four capacitors are employed as storage 
20 means for storing pixel signals that were previously read. If. for example, a 4 x 4 pixel block is used as the unit to be 
read. 12 capacitors must be provided as storage means. That is. when N x (N-1) storage means are provided for an N 
X N pixel block, as the unit to be read, signals can be read for each N x N pixel block, as well as for each 2x2 pixel 
blocK while having been horizontally shifted one pixel. 

[0210] The arrangement used for the horizontal reading is employed for vertical reading, and the vertical resolution 
25 can be increased by reading signals for each pixel block while a one pixel shift is performed. 

[0211] In addition, with a noise removal function, a more desirable Image signal can be obtained. 
[0212] Figs, 18 and 20 are diagrams showing example circuit structures ([Example 1] and [Example 2]) for the image 
pickup apparatus 700 that better implements the above embodiment Figs. 19 and 21 are timing charts showing oper- 
ating timings for the circuits in Figs. 18 and 20, respectively. 
30 [021 3] The circuit structures and operations for [Example 1] and [Example 2] will now be described. 

[0214] It should be noted that, as well as in the third to the fifth embodiments, a CMOS sensor Is employed as the 
image pickup apparatus 700 for the circuit structures in Figs. 18 and 20 (the image pickup apparatus 700 Is also here- 
inafter referred to as "the CMOS sensor 700"). The same reference numerals as used in Fig. 8 are also used to denote 
corresponding or identical components in the arrangements in Figs. 18 and 20, and no detailed explanation will be 
35 given for them. 

[Example 1] 

[0215] The CMOS sensor 700 in Fig. 18 can compute vertical pixel signals to obtain color signal CB. and can perform 
40 the above calculation for each column, such as for the first, the second, the second, the third, the third or the fourth. 
[0216] In the CMOS sensor 700, the level of a reset pulse input at a terminal 8 is set HIGH. When at time T71 1 a start 
pulse for the vertical scanning circuit 1 input at a terminal 2 and a scan pulse input at a terminal 3 go HIGH, the floating 
diffusion area in the pixel unit is reset. As a result, the vertical scanning circuit 1 begins scanning and selects the first 
line (R1). In addition, the pulse input at a terminal 1 1 also goes HIGH. In this state, when pulses input at terminals 30 
45 and 31 go HIGH, capacitors 221 . 222. 223 and 224 that serve as line memories (corresponding to capacitors C3. C4, 
C5 and Cq in Fig. 14 provided for the respective lines, and hereinafter referred to as "line memories") are reset. 
[0217] When at time T712 the reset pulse input at the terminal 8 goes LOW. the floating diffusion areas of pixels on 
the first line are set to the electrically floating state. The line memory is also set to the floating state. 
[0218] Next, when at time T713 the pulses input at the terminal 9 and 1 1 go HIGH, the charges are transmitted from 
so the photo detectors on the first line to the floating diffusion areas. 

[0219] When at time T714 pulses Input at the terminals 10. 30 and 50 go HIGH, the charges thiat were transmitted at 
time T713 are read for the line memory. 

[0220] Then, when at time T715 the vertical scan pulse Input to the terminal 3 goes LOW. the second line (R2) is 
selected. 

55 [0221] When at time T716 the reset pulse input at the terminal 8 goes LOW. the floating diffusion areas of pixels at 
the second line are set to the electrically floating state. Accordingly, the line memory is set to the floating state. 
[0222] When at time T717 the pulses input at the terminals 9 and 1 1 go HIGH, the charges are transmitted from the 
photo detectors on the second line to the floating diffusion areas. 
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[0223] When at time T718 the pulses input at the terminals 10. 30 and 50 go HIGH, the charges for the second line 
that were transmitted at time T717 are read for another line memory (a line memory that differs from the line memory 
at time T714). 

[0224] At time T719 the pulse input at the terminal 40 goes HIGH, and a mixed signal for two lines, i.e.. for the first 

5 and the second lines, is generated in the line memories. 

[0225] At time T720 the horizontal scanning circuit 4 is, activated to read mixed signals from the line memories. The 
mixed signals for two adjacent columns are output at the same time from the terminals 70 and 71 along two horizontal 
output lines, and a differential amplifier (not shown) at the succeeding stage performs a subtraction for these signals. 
As a result, the CMOS sensor 700 directly outputs a color signal. In addition, when the signals received along the two 

10 horizontal output lines are added together by an adder (not shown) at the succeeding stage, a luminance signal can 
also be obtained. 

[Example 2] 

15 [0226] The CMOS sensor 700 in Fig. 20 can compute vertical pixel signals to obtain color signal CR. and can perform 
the atKDve calculation for each column, such as for the first, the second, the second, the third, the third or the fourth. 
[0227] In the CMOS sensor 700. the level of a reset pulse input at a terminal 8 is set HIGH. When at time T731 a start 
pulse for the vertical scanning circuit 1 input at a terminal 2 and a scan pulse input at a terminal 3 go HIGH, the floating 
diffusion area in the pixel unit is reset. As a result, the vertical scanning circuit 1 begins scanning and selects the first 

20 line (R1). In addition, the pulse Input at a terminal 1 1 also goes HIGH. In this state, when pulses input at terminals 50 
and 51 go HIGH, capacitors 225. 226, 227 and 228, which serve as line memories (corresponding to capacitors C3. C4, 
C5 and C5 in Fig. 14 provided for the respective lines, and hereinafter referred to as "line memories"), are reset. 
[0228] When at time T732 the reset pulse input at the terminal 8 and the pulses input at the terminals 11 , 50 and 51 
go LOW. the floating diffusion areas of pixels on the first line are set to the electrically floating state. The line memory 

25 is also set to the floating state. 

[0229] Next, when at time T733 the pulses input at the terminals 9 and 1 1 go HIGH, the charges are transmitted from 
the photo detectors on the first line to the floating diffusion areas. 

[0230] When at time T734 pulses input at the terminals 1 0 and 50 go HIGH, the charges that were transmitted at time 
T733 are read for the line memory. 
30 [0231] Then, when at time T735 the vertical scan pulse input to the terminal 3 goes LOW, the second line (R2) is 
selected. 

[0232] When at time T736 the reset pulse input at the terminal 8 and the pulse input at the terminal 1 1 go LOW. the 
floating diffusion areas of pixels on the second line are set to the electrically floating state. Accordingly, the line memory 
is set to the floating state. 

35 [0233] When at time T737 the pulses input at the terminals 9 and 1 1 go HIGH, the charges are transmitted from the 
photo detectors on the second line to the floating diffusion areas. 

[0234] When at time T738 the pulses input at the terminals 10 and 50 go HIGH, the charges for the second line that 
were transmitted at time T737 are read for another line memory (a line memory that differs from the line memory at time 
T734). 

40 [0235] At time T739 the pulse input at the terminals 60 and 61 go HIGH, and a mixed signal for two lines, i.e.. for the 
first and the second lines, is generated in the line memories. 

[0236] At time T740 the horizorrtal scanning circuit 4 is activated to read mixed signals from the line memories. The 
mixed signals for two adjacent columns are output at the same time from the terminals 70 and 71 along two horizontal 
output lines, and a differential amplifier (not shown) at the succeeding stage performs a subtraction process for these 
45 signals. As a result, the CMOS sensor 700 directly outputs a color difference signal. In addition, when the signals 
received along the two horizontal output lines are added together by an adder (not shown) at the succeeding stage, a 
luminance signal can also be obtained. 

[0237] The arrangements for implementing the calculations for vertical pixel signals have been explained in Examples 
1 and 2. When the same arrangement is employed for the calculation of horizontal pixel signals, the calculations for 
50 each line, such as the first, the second, the second, the third, the third or the fourth line, can be performed. 

[0238] In addition, when a circuit shown in Fig. 22 is formed by using both circuit structures in Figs. 1 8 and 20, and 
the operating timing is set as shown in Fig. 23. color difference signals CB and CR can be output at the same time. A 
luminance signal can also be output at the same time. 

[0239] In the processing for the CMOS sensor 700 explained while referring to Figs. 18 to 23. a reset voltage for a 
55 floating diffusion area may be read for another line memory before a charge (light signal) for a pixel is read. A variance 
in an output voltage due to a variance in a threshold voltage of the transistor 104 can be removed by calculating the 
difference between the reset voltage and the light signal. Therefore, since a noise element that is caused by such a var- 
iance is not mixed with a signal that corresponds to the light quantities detected by the photodetectors, signals having 
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a high S/N ratio can be obtained. 

[0240] The present invention is not limited to the CMOS sensor that has the circuit structure explained in the third to 
the sixth embodiments, but can also be employed for a CMOS sensor having a different circuit structure. The present 
invention can also be enrployed, for example, for a CMD. a BASIS or an SIT image pickup apparatus, and the same 
5 effects can be provided as are obtained in the above embodiment. 

(Seventh Embodiment) 

[0241 ] Generally, an image signal processing system that processes color image signals first performs predetermined 
10 pro-processing for an original signal (pixel signal) that is output by a pixel unit, and generates luminance signal Y and 
color signals CR and CB. Then, the image signal processing system performs white balance correction, y correction 
arxJ other colo^ correction for color data by employing the luminance signal Y and color signals CR and CB, and gener- 
ates a complete luminance signal Y' and color difference signals CR' and CB'. The luminance signal Y' and color differ- 
ence signals CR* and CB' are used for image processing, such as image compression or expansion, or for a screen 
15 display or for recording on a memory medium. 

[0242] In a seventh embodiment, the present invention is applied for the above described Image processing system 
that processes color image signals. 

[0243] In the Image signal processing system according to the present invention, as is shown in Fig. 24. data are 
exchanged between a transmission side that comprises an Image pickup device 810 and an information compression 
20 device 820, and a reception side that comprises an Information expansion device 830. a color processing device 840 
and an image display/storage device 850. 

[0244] The most important feature of the image signal processing system 800 Is the Image pickup device 810. 
[0245] The image pickup device 810 functions the same as the image pickup unit 710 in Fig. 3, and comprises, as is 
shown in Fig. 3, a color filter 71 1 , a pixel unit 71 2. a signal reading unit 713 and a luminance/color difference preparation 
25 unit 720, all of which are mounted on a single IC chip. Since the luminance/color difference preparation unit 720 is 
mounted together with the pixel unit 712 on the same IC chip, the load imposed on the processing performed at the suc- 
ceeding state can be reduced. 

[0246] The processing performed by the image signal processing system will now be described. 

[0247] First, on the transmission side the object light is transmitted to the pixel unit 712 through the color filter 71 1 

30 that has the filter array shown in Figs. 4 to 7. 

[0248] Pixel signals (original signals) Ye. Cy. Mg and G obtained at the pixel unit 712 are read by the signal reading 
unit 713 in the same manner as explained In the first to the sixth embodiments, and are employed by the lumi- 
nance/color difference preparation unit 720 to generate luminance signal Y and color difference signals CR and CB. 
[0249] The Information compression device 820 employs an information compression technique, such as JPEG. 

35 MPEG, H.261 or vector quantization, to compress the luminance signal Y and color difference signals CR and CB that 
are generated by the image pickup device 810, without performing the white balance or a y correction for color informa- 
tion. 

[0250] Specifically, the compression device 820 first performs a DCT (Discrete Cosine Transformation) for each pre- 
determined nurr^er of pixel blocks. Then. luminance signal Y and color difference signals CR and CB that were 
40 obtained by the DCT are quantized, and compressed data from which high frequency elements have been removed are 
generated. The compressed data are then' encoded. While various encoding methods can be employed, a variable 
length encoding method for allocating a code length that corresponds to the frequency of the generation of data can be 
employed to increase the compression rate. 

[0251] The data that are compressed arxi encoded by the compression device 820 are transmitted via a medium, 
45 such as a communication line, to the information expansion device 830 on the reception side. 

[0252] On the reception side, the Information expansion device 830 performs an inverted DCT and quantization proc- 
ess, which were performed by the compression device 820. for the data received from the transmission side and obtains 
the luminance signal Y and color signals CR and CB. 

[0253] The color processing device 840, in order to acquire a satisfactory image quality, performs various color proc- 
50 esses, such as white balance correction or y correction, for the luminance signal Y and color signals CR and CB that 
are obtained by the information expansion device 830, and generates luminance signal Y' and color difference signals 
CR* and CB* in their complete forms. 

[0254] The image display/storage device 850 displays, on a screen, the luminance signal Y' and color signals CR* and 
CB' generated by the color processing device 840, or stores them in a memory medium. 
55 [0255] As is described above, in this emtxxjiment, the filter array shown In Figs. 4 to 7 Is employed for the color filter 
71 1. and pixel signals obtained at the pixel unit 712 are read In the same manner as was explained in the first to the 
sixth embodiments. As a result, the Image processing system that processes color Image signals can obtain the same 
effect as In the first to the sixth embodiments. In other words, color Image signals with horizontally and vertically high 
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resolutions can be obtained at a high speed. 

[0256] In addition, the iuminance/color difference preparation unit 720. which generates luminance signal Y and color 
difference signals CR and CB from original signals Ye. Cy. Mg and G obtained by the pixel unit 712. is mounted together 
with the pixel unit 712 on the same chip. Therefore, fast calculations for obtaining luminance signal Y and color differ- 
ence signals CR and CB can be performed, and the image processing, such as image compression and expansion at 
the succeeding stages, can be performed efficiently 

[02571 With the above described arrangement, the increase in the processing speed can also be employed for the 
improvement of the accuracy of image processing, such as the image compression and expansion, so that a color 
image signal having a higher image quality can be obtained. 

[0258] Further, the compression device 820 compresses and encodes luminance signal Y and color signals CR and 
CB that are received from the image pickup device 810, the information expansion device 830 expands the resultant 
data, and the color processing device 840 performs color processing, such as white balance correction or y correction, 
for the data to obtain a high image quality. Therefore, the deterioration of image quality, which is caused by block noise 
or high-frequency noise that is generated during the expansion process performed after the compression, can be held 
to the minimum. As a result, the volume of data to be stored on a memory medium by the image display/storage device 
850 or to be transmitted via a communication line can be reduced, and deterioration of the image quality can be pre- 
vented so that an image having a high quality can be provided. 

[0259] In the seventh embodiment, the DCT and the variable length encoding process are used for the compression 
performed at the compression device 820. However, a code book compression technique (vector quantization tech- 
nique) can also be employed. 

[0260] According to the code book compression technique, first, the compression device 820 compares luminance 
signal Y and color signals CR and CB. which are generated by the image pickup device 810. with a plurality of code 
books (patterns) that are stored In advance and determines which pattern is the most similar. The compression device 
820 then transmits to the expansion device 830 on the reception side a code number that corresponds to the pattern, 
[0261] The expansion device 830 extracts, from a plurality of code books that are stored in advance, a pattern that 
corresponds to the code number received from the compression device 820, and reproduces an image signal that was 
compressed by the compression device 820. 

[0262] In the above described embodiments, the color filter 71 1 is a complementary color filter wherein are arranged 
color filters for four complementary colors, yellow (Ye), magenta (Mg). cyan (Cy) and green (G). The color filter 711. 
however, is not limited to this type, and any other filter may be employed so long as the luminance signal and color sig- 
nals can be obtained. 

[0263] However, when a color filter 71 1 that is a primary color filter composed of filters having three primary colors. 
R. G and B. is compared with the color filter 71 1 that is the complementary color filter that, as in the above embodi- 
ments, is composed of filters of four complementary colors, the complementary color filter can provide better effects. 
This is because all the color filters that constitute the complementary color filter include color connponents. so that a 
shortcoming can be prevented whereof a luminance signal and the rate of use of incident light are both low and the sen- 
sitivity is reduced. 

[0264] Further, the objective of the present invention is achieved as follows: a memory medium on which is stored 
software program code for implementing the functions of a host and a terminal in the previous embodiments is supplied 
to a system or to an apparatus, and the computer (or a CPU or an MRU) in the system or the apparatus reads the pro- 
gram code from the memory medium. 

[0265] In this case, the program code read from the memory medium accomplishes the functions of the above 
described embodiments, and the memory medium on which the program code is stored constitutes the present inven- 

[0266] A memory medium for supplying such program code can be. for example, a ROM a floppy disk, a hard disk, 
an optical disk, a magneto optical disk, a CD-ROM, a CD-R, a magnetic tape, or a nonvolatile memory card. 
[0267] In addition, the scope of the present invention includes not only a case where the functions in the previous 
embodiment can be performed when program code is read and executed by the computer, but also a case where, 
according to an instruction in the program code, an OS running on the computer performs one part, or all. of the actual 
processing required to accomplish, the functions included in the above embodiments. 
[0268] " Furthermore; the present invention indudes a case where program code, read from a menrw^^ 
ten in a memory that is mounted on a function expansion board inserted into a computer, or a function expansion unit 
connected to a computer, and In consonance with program code instructions, a CPU mounted on the function expan- 
sion board, or the function expansion unit performs one part, or all. of the actual processing in order to implement the 
functions included in the alcove described embodiments. 

[0269] As is described above, according to the embodiments, a color filter array is so designed that filters for a plurality 
of colors are sequentially arranged as a unit of N lines and N columns, and that in the cyclic patterned unit of N lines x 
N columns, the colors of the filters differ from each other not only on the see line but also in the same column. 
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[0270] Therefore, pixel signals that are required to generate a luminance signal and color signals for a predetermined 
pixel block unit can be obtained for all the pixel blocks, so that a luminance signal and color signals having high resolu- 
tions can be generated. When these signals are employed for an easy color display, as automatic focusing detection 
signals, for the adjustment of white balance or for image compression, a satisfactory color image can be provided. 
5 [0271] Specifically, for a color filter array in which, for example, filters for four colors, the first to the fourth color (cyan 
Cy, yellow Ye. magenta Mg and green G). are arranged as units of 4 lines and 4 columns, filters for the same color do 
not overlap in the direction of the lines and the columns in a unit of 4 lines and 4 columns, such as 

first line: first color, second color, third color and fourth color 
10 second line: third color, fourth color, first color and second color 
third line: second color, first color, fourth color and third color, and 
fourth line: fourth color, third color, second color and first color. 

[0272] Therefore, the pixel signals for the first to the fourth colors can be obtained from ail the pixel block units of 2 
15 lines and 2 columns, i.e., the pixel signals can be obtained that are required for the calculation of a luminance signal 
and color signals. As a result, the conventional shortcoming whereby the calculations for a luminance signal and color 
signals can not be performed for a specific line can be resolved. 

[0273] In addition, when pixel signals obtained from object light that has passed through the color filter array are to 
be read as a pixel block unit of N lines x N columns, a pixel block to be read next is defined as a block that has been 
20 shifted away from a preceding pixel block horizontally or vertically, or txjth horizontally and vertically, a distance equiv- 
alent to a predetermined number of pixels, so that the resolution can be increased. 

[0274] More specifically, for reading pixel signals as a pixel block unit of 2 lines and 2 columns, first, the first pixel block 
is read so as to obtain pixel signal -, on the first line and in the first column, pixel signal Y^g on the first line and in the 
second column, pixel signal Y21 on tiie second line and in the first column, and pixel signal Y22 on the second line and 

25 in the second column. Among these pixel signals, are stored pixel signals *hat are located in portions (the 

first line and the second column, and the secorxj line and the second column) that overlap a second pixel t>lock that is 
to be read next (a block that has horizontally been shifted one pixel away from the first pixel biock). For reading the fol- 
lowing pixel block, these stored pixel signals Y12 and Y21 are employed as pixel signals for the overlapping areas. 
[0275] As a result, a luminance signal and color signals that correspond to individual pixels in the horizontal direction 

30 can be obtained from the pixel block unit of 2 lines and 2 columns. Therefore, in this case, the horizontal resolution can 
be doubled. 

[0276] Further, for each pixel block of 2 lines and 2 columns, a mode (a mode for signal reading method 1) Is 
employed in which, for example, a difference is read between a signal that is obtained by adding a pixel signal on the 
first line and in the first column to a pixel signal on the first line and in the second column and a signal that is obtained 

35 by adding a pixel signal on the second line and in the first column to a pixel signal on the second line and in the second 
column, and a difference is read between a signal that is obtained by adding a pixel signal on the first line and in the 
first column to a pixel signal on the second line and in the first column and a signal that is obtained by adding a pixel 
signal on the first line and in the second column to a pixel signal on the second line and in the second column. Then, a 
color image signal can be obtained that has color difference signals having high resolutions horizontally and vertically. 

40 [0277] In addition, since there are various signal reading methods that employ the same color filter pattern, a multi- 
mode, such as a mode for outputting at high speed image signals that can be used for an easy color display, for auto- 
matic focusing or for automatic white balance, and a mode for outputting image signals having high resolutions, can be 
coped with. 

[0278] Furthermore, since a luminance signal and color difference signals are obtained by the image pickup device 
45 using the signal reading method described above, and since the data are compressed witiiout performing a color proc- 
ess, such as white balance or y correction, and the color processing is performed after the expansion of data, data can 
be compressed eff icientiy and the deterioration of images after color processing has been performed can be prevented. 

Claims 

so 

1 . An image pickup apparatus comprising: 

a plurality of pixels arranged horizontally and vertically; and 
a color filter array for four colors arranged in said plurality of pixels. 
55 wherein said color filter array has a cyclk: pattern of four rows x four columns, and 

wherein, in the cyclic pattern unit comprising four rows and four columns, colors of color filters on the same row 
differ from each otiier and colors of said color filters in the same column differ from each other. 
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2. An image pickup apparatus according to claim 1 . further comprising: 

first addition means for adding signals for pixels that are adjacent to each other horizontally or/and vertically. 

3. An image pickup apparatus according to claim 2, further comprising: 

subtraction means for performing a subtraction between a plurality of signals that are added together by said 
first addition means. 

4. An image pickup apparatus according to claim 2. further comprising: 

second addition means for. adding together a plurality of signals that are added together by said first addition 
means. 

5. An image pickup apparatus according to claim 1 . further comprising: 

first addition means for adding signals for pixels that are adjacent to each other horizontally and/or vertically; 
subtraction means for performing a subtraction between a plurality of signals that are added together by said 
first addition means; and 

second addition means for adding together a plurality of signals that are added together by said first addition 
means. 

6. An image pickup apparatus according to one of claims 1 to 5. wherein said color filters are a filter for transmitting 
only green light within a visible radiation range, a filter for absorbing only a blue light within said visible radiation 
range, a filter for absorbing only green light within said visible radiation range, and a filter for absorbing only red light 
within said visible radiation range. 

7. An image pickup apparatus comprising: 

a plurality of pixels arranged horizontally and vertically; and 

a color filter array of N colors (N is an integer) arranged in said plurality of pixels. 

wherein said color filter array is so arranged that luminance signals are generated from all the rows and all the 
columns. 

8. An image pickup apparatus according to claim 7. further comprising: 

luminance signal generation means for generating a luminance signal by using signals that are read from said 
plurality of pixels; and 

color signal generation means for generating a color signal by using signals that are read from said plurality of 
pixels. 

9. An image pickup apparatus according to claim 8. wherein said luminance signal generation means adds together 
signals for a plurality of pixels that are adjacent to each other horizontally or/and vertically 

10. An image pickup apparatus according to claim 7. further comprising: 

first addition means for adding signals from pixels that are adjacent to each other horizontally or/and vertically 

1 1 . An image pickup apparatus according to claim 10, further comprising: 

subtraction means for performing a subtraction between a plurality of signals that are added together by said 
first addition means. 

12. An image pickup apparatus according to claim 8. further comprising: 

second addition means for adding together a plurality of signals that are added together by said first addition 
means. 



24 



:<EP ^0926901 Aa»L> 



EP0 926 901 A2 



13. An image pickup apparatus according to claim 7. further comprising: 

first addition means for adding signals for pixels that are adjacent to each other horizontally and/or vertically: 
subtraction means for performing a subtraction between a plurality of signals that are added together by said 
5 first addition means; and 

second addition means for adding together a plurality of signals that are added together by said first addition 
means. 

14. An image pickup apparatus according, to one of claims 7 to 1 3. wherein said color filters are for four colors, and are 
10 a filter for transmitting only green light within a visible radiation range, a filter for absorbing only a blue light within 

said visible radiation range, a filter for absorbing only green light within said visible radiation range, and a filter for 
absorbing only red light within said visible radiation range. 

15. An image pickup apparatus comprising: 

15 

a plurality of pixels arranged horizontally and vertically; and 

a color filter array of four colors arranged in said plurality of pixels. 

wherein said color filter array is so arranged that two color difference signals are generated by a cyclic pattern 
of two rows X two columns by using addition signals of pixels in the horizontal direction and by using addition 
so signals of pixels in the vertical direction. 

16. An image pickup apparatus according to daim 15. further comprising: 

first addition means for adding signals for pixels that are adjacent to each other horizontally and/or vertically; 
25 subtraction means for performing a subtraction between a plurality off signals that are added together by said 

first addition means: and 

second addition means for adding together a plurality of signals that are added together by said first addition 
means. 

30 1 7. An image pickup apparatus according to claim 1 5 or 1 6. wherein said color filters are for four colors, and are a filter 
for transmitting only green light within a visible radiation range, a filter for absorbing only a blue light within said vis- 
ible radiation range, a filter for absorbing only green light within said visible radiation range, and a filter for absorbing 
only red light within said visible radiation range. 

35 18. An image pickup apparatus comprising: 

a plurality of pixels arranged horizontally and vertically; 

a plurality of vertical output lines along which signals produced by said plurality of pixels are read; 
a plurality of storage means, provided along said vertical output lines, for the storage of said signals produced 
40 by said plurality of pixels: 

first addition means, provided along said vertical output lines, for adding together signals produced by pixels 
on the same row that are output by said plurality of storage means; 

second addition means, provided along said vertical output lines, for adding together signals produced by pix- 
els in the same column that are output by said plurality of storage means; and 
45 a horizontal output line along which are read resultant signals produced by said first addition means and said 

second addition means. 

19. An image pickup apparatus according to daim 18. wherein said first and said second addition means employ a 
switch to add signals stored in said storage means. 

50 

20. An image pickup apparatus according to daim 19, wherein said switch indudes an MOS transistor. 

21. An image pickup apparatus according to claim 18, wherein a color filter array for four colors arranged in said plu- 
rality of pixels; wherein said color filter array has a cyclic pattern of four rows x four columns; and wherein, in the 

55 cydic pattern unit comprising four rows and four columns, cdors of color filters on the same row differ from each 
other and colors off said color filters in the same column differ from each other. 

22. An image pickup apparatus according to claim 18, wherein a color ffilter array off N colors an^anged in said plurality 
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of pixels; and wherein said color filter array is so arranged that luminance signals are generated from all the rows 
and all the columns. 

23. An image pickup apparatus according to claim 18. wherein a color filter array of four colors arranged in said plurality 
5 of pixels; and wherein said color filter array is so arranged that two color difference signals are generated by a cyclic 

pattern of two rows x two columns by using addition signals of pixels in the horizontal direction and by using addi- 
tion signals of pixels in the vertical direction, 

24. An image pickup apparatus comprising: 
10 < 

a plurality of pixels arranged horizontally and vertically; and 

addition means for adding together pixels that are located adjacent to each other horizontally and/or vertically, 
while shifting said plurality of pixels by one pixel. 

75 25. An image pickup apparatus comprising: 

a plurality of pixels arranged horizontally and vertically; . 

readout means for reading out signals produced by said plurality of pixels as a unit, connprising a pixel block 
that is composed of P rows x Q columns (P and Q are integers), while shifting said plurality of pixels horizon- 
20 tally or/and vertically by one pixel or predetermined number of pixels; and 

saving means for saving signals produced in an area that overlaps the next pixel block that is shifted said pre- 
determined number of pixels away from said pixel block, in the area of the pixel block that is read by said rea- 
dout means, 

wherein said readout means employs said signals stored in said saving means to read a succeeding pixel 
25 block 

26. A method for reading an image signal produced by an image pickup apparatus in which four color filters ire dis- 
posed, comprising the step of: 

30 calculating A + B - C - D for signals A, B, C and D produced by pixels at which ore positioned said four color 

filters. 

wherein pixels from which signals A and B are output are located adjacent to each other horizontally or verti- 
cally; and 

wherein said color filters have a cyclic pattern of four rows x four columns, and, in said cyclic pattern of four 
35 lines and four columns, colors of color filters on the same row differ from each other and colors of said color 

filters in the same column differ from each other. 

27- A method for reading an image signal produced by an image pickup apparatus in which fouH- color filters are dis- 
posed, comprising the step of: 

40 

calculating A + B - C - D for signals A. B. C and D produced by pixels at which are positioned said four color 
filters. 

wherein pixels from which signals A and B are output are located adjacent to each other horizontally or verti- 
cally; and 

45 wherein said color filters have a cyclic pattern of four lines x four columns, and are so arranged that luminance 

signals are generated from all said rows and all said columns. 

28. A method for reading an image signal produced by an image pickup apparatus in which four color filters are dis- 
posed, comprising the step of: 

so 

calculating A + B - G - D for signals A, B, C and D produced by pixds at which are positioned said four color 
filters, 

wherein pixels by which signals A and B are output are located adjacent to each other horizontally or vertically; 
and 

55 wherein said color filters are so arranged that two color difference signals are generated by a cyclic pattern of 

two rows X two columns by using addition signals of pixels in the horizontal direction and by using addition sig- 
nals of pixels in the vertical direction. 
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29. An image processing system comprising: 

an image pickup apparatus in which is mounted a color filter array for four colors; 

a compressor for compressing data; 
5 a decompressor for decompressing compressed data; and 

a color processor for at the least performing an adjustment for white balance or tor y correction. 

wherein a signal from said image pickup apparatus is transmitted to said compressor without passing through 

said color processor, and a signal compressed by said compressor is decompressed by said decompressor, 

the resultant signal being transmitted to said color processor; 
10 wherein said color filter array has a cyclic pattern of four rows x four columns; and 

wherein, in said cyclic pattern of four lines and four columns, colors of color filters on the same row differ from 

each other and colors of said color filters In the same column differ from each other. 

30. An image processing system comprising: 

15 

an image pickup apparatus in which Is mounted a color filter array for N colors (N Is an integer); 

a compressor for compressing data; 

a decompressor for decompressing compressed data; and 

a color processor for at the least performing an adjustment for a white balance or for y correction. 
20 wherein a signal from said image pickup apparatus Is transmitted to said compressor without passing through 

said color processor, and a signal compressed by said compressor is decompressed by said decompressor, 
the resultant signal being transmitted to said color processor; and 

wherein said color filter array Is so arranged that luminance signals are generated from all the rows and all the 
columns. 

25 

31. An image processing system comprising: 

an image pickup apparatus in which is mounted a color filter array for N colors (N is an Integer); 

a conpressor for compressing data; 
30 a decompressor for decompressing compressed data; and 

a color processor for at the least performing an adjustment for white balance or for y correction. 

wherein a signal from said image pickup apparatus Is transmitted to said conrpressor without passing through 

said color processor, and a signal compressed by said compressor is decompressed by said decompressor, 

the resultant signal being transmitted to said color processor; and 
3S wherein said color filter array Is so anranged that two color difference signals are generated for a cyclic pattern 

of two rows X two columns by using addition signals of pixels In the horizontal direction and by using addition 

signals of pixels in the vertical direction. 
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FIG. 3 
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FIG. 4 
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FIG. 6 
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FIG. 8 
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(54) Colour image pickup apparatus 

(57) To provide an image pickup apparatus that 
generates an innage signal having a high resolution both 
horizontally and vertically, the filter an-angement for a 
color filter array used in the apparatus is so designed 
that the colors of the filters in a cyclic patterned unit of N 
rows X N columns (4 lines x 4 columns) differ from each 
other not only on the same line but also in the same col- 
umn. Thus, from all the pixel blocks, pixel signals for 
each predetermined pixel block unit can be obtained 
that are required for the generation of a luminance sig- 
nal and of color signals. 



FIG. 4 





CI 


C2 


C3 


C4 


LI 


G1 


Ye1 


Cy2 


Mg2 


L2 


Cyl 


Mgl 


G2 


Ye2 


L3 


Ye3 


03 


Mg4 


Cy4 


L4 


Mg3 


Cy3 


Ye4 


G4 



Printed by Xerox (UK) Business Senrioes 
2.16.7 (HRS)/3.6 



BNSOOCID: <EP 0926901 A3J_> 



EP 0 926 901 A3 



European Patent 
Office 



EUROPEAN SEARCH REPORT 



Application Number 

EP 98 31 0696 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 



Citation of document with indication, where appropriate, 
of relevant passages 



Relevant 
to cl;um 



CLASSIFICATION OF THE 
APPLICATION (lntCI.6) 



Y 
A 



P.A 



US 5 631 703 A (ADAMS JR JAMES E ET AL) 
20 May 1997 (1997-05-20) 



* column 3, line 8 - line 29 * 

* column 4, line 8 - line 16 * 

EP 0 813 343 A (CANON KK) 

17 December 1997 (1997-12-17) 

* figure 8 * 

* page 7, line 44 - line 56 * 

US 5 614 947 A (YONEYAMA MASAYUKI ET AL) 
25 March 1997 (1997-03-25) 

* colurm 1, line 34 - line 67; figure 13 * 

US 5 568 192 A (HANNAH ERIC C) 
22 October 1996 (1996-10-22) 

* column 5. line 54 - line 59; figure 6 * 

* colurm 1, line 58 - column 2, line 10; 
figure 3 * 

JP 10 336486 A (MATSUSHITA ELECTRIC IND CO 
LTD) 18 December 1998 (1998-12-18) 

* figure 1 * 



The present search report has lieen drawn up for all daims 



1-17.24 

29-31 

18-23, 

25-28 



1-28 



1-28 



29-31 



H04N9/04 



TECHNICAL FIELDS 
SEARCHED (lnLa.6) 



29-31 



HG4N 



Ptaoa of wafch 

THE HAGUE 



DM0 d conplatiofi of the March 

27 September 2000 



De Paepe, W 



s 



CATEGORY OF CITED DOCUMEMTS 

X : partioularfy ivlvvaiit 9 tak*n slotw 

Y : psrtiaulariy i«l«v«nt V oorrbin«d wtti another 

document of tti* Mm* oategery 
A : teohnobgioaJ beokground 
O : fion-writtefi dtsoloMr* 
P : ifitennadiats doeumant 



T : theory or prifiof>le tmdertymg the jnvention 
E: earlier patent dooument, but pi4>iehed on. or 

after the fling dale 
O : doeument cited in the applioation 
L : document eKed for other raaaona 



& : member of the same patent famBy, ooneipomfing 
dcMument 



2 



BNSOOCID: <EP 0926901 A3J_> 



EP 0 926 901 A3 




European Patent 
Office 



EP 98 31 0696 



Application Numbar 



CLAIMS INCURRING FEES 



The present European patent application comprised at the time of filing more than ten claims. 

□ Only part of the claims have been paid wHhtn the prescribed time limit The present European search 
report has been drawn up for the first ten claims and for those claims for which claims fees have 
been paid, namely claim (s): 



□ No claims fees have been paid within the prescribed time limit. The present European search report has 
been drawn up for the first ten claims. 



The Search Division considers that the present European patent application does not comply with the 
requirements of unity of invention and relates to several inventions or groups of inventions, namely: 



see sheet B 



Ail further search fees have been paid within the fixed time Gmrt. The present European search report has 
been drawn up for all claims. 



□ As all searchable claims could be searched without effort justifying an additional fee, the Search Division 
did not invite payment of any additional fee. 

□ Only part of the further search fees have been paid within the fixed time limit. The present European 
search report has been drawn up for those parts of the European patent application which relate to the 
inventions in respect of which search fees have been paid, namely claims: 



None of the further search fees have been paid within the fixed tinie limit. The present European search 
report has lieen drawn up for those parts of the European patent appfication which relate to the invention 
first mentioned in the claims, nanwly claims: 



LACK OF UNITY OF INVENTION 




3 



BNSDOCID: <EP. 



.0926901 A3J_> 



EP 0 926 901 A3 




European Patent 
Office 



LACK OF UNITY OF INVENTION 
SHEET B 



EP 98 31 G695 



Appiieation Numter 



The Search Oh/I&ion considers that the present European patent application does not comply with the 
requirements of unity of invention and relates to several inventions or groups of inventions, namely: 

1. Claimi: 1-28 

Image color pickup apparatus calculating A+B-C-D for signals 
A,B,C and D produced by color pixels. 



2- Claims: 29-31 

Image processing system comprising a compressor, 
deconpressor and a color processor for white balance or for 
Y correction. 



4 



0926901 A3 l_> 



EP 0 926 901 A3 



ANNEX TO THE EUROPEAN SEARCH REPORT 

ON EUROPEAN PATENT APPLICATION NO. EP 98 31 0696 



ThiB annex lists the patent family members relating to the patent documents cited in the afoove-menrtioned European search report. 
The members are as contained in the European Patent Oifice 60P fite on 

The European Patent Office is in no way liable for these particulars which are merely given for the purpose of information. 

27-G9-2O0O 



Patent document 
cited in search report 


Publication 
date 


Patent family 
memtxM^s) 


Publication 
date 


us 5631703 


A 


20-05-1997 


EP 


0810795 A 


03-12-1997 








JP 


10066094 A 


06-03-1998 


EP 0813343 


A 


17-12-1997 


JP 


9331538 A 


22-12-1997 


US 5614947 


A 


25-03-1997 


JP 


7007736 A 


10-01-1995 








JP 


7107496 A 


21-04-1995 








OE 


69420469 0 


14-10-1999 








OE 


69420469 T 


04-05-2000 








EP 


0630159 A 


21-12-1994 








KR 


146260 B 


15-09-1998 


US 5568192 


A 


22-10-1996 


NONE 






JP 1G336486 


A 


18-12-1998 


NONE 







s 



O 

Si For more details about this annex : see Official Journal of the European Patent Office, No. 12/82 



5 



BNSOOCID: <EP ^092690 1A3J_> 



THIS PAGE BLANK (MSPTO) 



